-- Logs begin at Thu 2022-07-14 11:10:40 UTC, end at Thu 2022-07-14 12:13:47 UTC. -- Jul 14 11:46:48.839231 dv-osbrick-849324-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 11:46:48.847255 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 11:46:48.850055 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 11:46:48 2022] *** Jul 14 11:46:48.850190 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 11:46:48.850284 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 11:46:48.850376 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: nodename: dv-osbrick-849324-4-ceph Jul 14 11:46:48.850458 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: machine: x86_64 Jul 14 11:46:48.850552 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: clock source: unix Jul 14 11:46:48.850552 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: pcre jit disabled Jul 14 11:46:48.850552 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: detected number of CPU cores: 4 Jul 14 11:46:48.850552 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: current working directory: / Jul 14 11:46:48.850552 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: detected binary path: /usr/bin/uwsgi-core Jul 14 11:46:48.850552 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: your processes number limit is 47680 Jul 14 11:46:48.850552 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: your memory page size is 4096 bytes Jul 14 11:46:48.850552 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: detected max file descriptor number: 2048 Jul 14 11:46:48.850552 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: lock engine: pthread robust mutexes Jul 14 11:46:48.851029 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: thunder lock: enabled Jul 14 11:46:48.851029 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 11:46:48.851029 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 11:46:48.899382 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: Python main interpreter initialized at 0x5623e5d859c0 Jul 14 11:46:48.899382 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: python threads support enabled Jul 14 11:46:48.899382 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: your server socket listen backlog is limited to 100 connections Jul 14 11:46:48.899382 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: your mercy for graceful operations on workers is 90 seconds Jul 14 11:46:48.899775 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 11:46:48.899852 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: *** Operational MODE: preforking *** Jul 14 11:46:48.900091 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: *** uWSGI is running in multiple interpreter mode *** Jul 14 11:46:48.900091 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: spawned uWSGI master process (pid: 87119) Jul 14 11:46:48.900324 dv-osbrick-849324-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 14 11:46:48.901400 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: spawned uWSGI worker 1 (pid: 87129, cores: 1) Jul 14 11:46:48.901400 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: spawned uWSGI worker 2 (pid: 87130, cores: 1) Jul 14 11:46:48.901400 dv-osbrick-849324-4-ceph devstack@keystone.service[87119]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 11:46:54.696813 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:46:54.696813 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: from cryptography.utils import int_from_bytes Jul 14 11:46:54.697622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:46:54.697622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: from cryptography.utils import int_from_bytes Jul 14 11:46:54.697732 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:46:54.697732 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: from cryptography.utils import int_from_bytes Jul 14 11:46:54.697732 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:46:54.697732 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: from cryptography.utils import int_from_bytes Jul 14 11:46:54.746487 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:46:54.746768 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:46:54.746939 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:46:54.747042 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] command line args: [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:46:54.747224 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:46:54.747304 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:46:54.747405 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ================================================================================ {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:46:54.747490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] command line args: [] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:46:54.747660 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] admin_token = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.747746 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:46:54.747856 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ================================================================================ {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:46:54.747955 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] config_dir = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.748109 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.748194 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] admin_token = **** {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.748294 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] config_source = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.748370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] config_dir = [] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.748472 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] debug = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.748551 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.748670 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.748979 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] config_source = [] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.748979 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] debug = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.749203 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.749310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.749440 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.749545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.749653 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.749756 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.749867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.749966 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.750067 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] list_limit = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.750169 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.750282 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] log_config_append = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.750282 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.750466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] list_limit = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.750562 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] log_dir = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.750663 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] log_config_append = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.750765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] log_file = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.750872 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.750974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.751035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] log_dir = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.751096 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.751201 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] log_file = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.751321 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.751425 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.751586 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.751670 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.751742 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.751819 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.751934 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.752027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.752108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.752179 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.752307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.752433 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.752521 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.752597 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.752759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.752899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.752974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.753103 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.753193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.753310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.753435 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.753526 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.753678 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.753758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.753955 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.754041 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.754244 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.754443 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.754523 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.754642 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] publish_errors = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.754868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.755008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.755093 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.755207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] publish_errors = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.755287 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.755437 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.755571 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.755687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.755817 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.755976 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.756095 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] standard_threads = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.756216 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.756330 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.756509 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.756627 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.756740 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] standard_threads = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.756852 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.756852 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] use_journal = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.757062 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.757182 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] use_json = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.757303 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.757417 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] use_stderr = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.757535 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.757649 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] use_syslog = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.757774 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] use_journal = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.757896 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.758015 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] use_json = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.758129 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.758241 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] use_stderr = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.758241 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] use_syslog = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.758459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.758573 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:46:54.758686 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.758798 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.758910 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.759006 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.759111 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.759206 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.759307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.759410 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.759516 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.759612 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.759715 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.759818 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.759997 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.760119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.760224 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.760324 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.760445 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.760445 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.760657 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.760776 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.760896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.761009 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.761130 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.761250 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.761364 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.761477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.761589 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.761701 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.761889 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.762006 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.762120 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.762238 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.762352 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.762465 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.762586 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.762701 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.762813 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.762932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.763054 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.763173 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.763301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.763416 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.763528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.763641 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.763760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.763874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.764017 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.764132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.764245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.764357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.764469 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.764582 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.764703 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.764817 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.764929 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.765048 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.765824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.765949 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.766065 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.766179 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.766179 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.766390 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.766503 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.766627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.766627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.766836 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.766950 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.767062 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.767174 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.767300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.767414 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.767527 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.767640 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.767759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.767872 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.768090 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.768214 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.768328 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.768328 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.768544 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.768663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.768785 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.768901 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.769013 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.769126 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.769238 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.769351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.769471 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.769585 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.769964 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.770079 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.770192 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.770304 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.770424 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.770539 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.770657 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.770770 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.770883 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.770996 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.771119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.771233 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.771352 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.771465 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.771579 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.771721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.771849 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.771989 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.772111 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.772226 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.772339 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.772453 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.772574 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.772703 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.772818 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.772941 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.773058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.773178 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.773301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.773424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.773547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.773670 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.773785 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.773898 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.774018 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.774144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.774266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.774381 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.774495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.774617 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.774737 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.774852 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.774974 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.775096 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.775211 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.775324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.775437 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.775550 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.775671 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.775787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.775921 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.776052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.776169 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.776281 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.776402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.776517 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.776517 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.776728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.776842 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.776962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.777078 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.777191 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.777305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.777418 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.777531 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.777652 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.777767 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.777881 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.777994 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.778108 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.778222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.778343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.778448 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.778560 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.778674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.778786 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.778899 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.779335 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.779457 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.779555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.779650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.779767 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.779881 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.780164 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.780285 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.780401 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.780515 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.780629 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.780743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.781432 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.781564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.781692 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.781933 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.782063 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.782180 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.782294 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.782415 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.782415 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.782644 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.782644 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.782865 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.782979 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.783092 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.783214 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.783329 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.783443 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.783557 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.783670 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.783792 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.783939 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.784064 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.784179 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.784293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] auth.external = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.784405 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.784519 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.784645 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.784760 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.784875 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.784988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.785100 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.785222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] auth.password = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.785342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.785482 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] auth.token = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.785611 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] auth.external = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.785733 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.785849 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.785969 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.786084 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.786208 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.786324 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.786437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.786551 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] auth.password = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.786665 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.786779 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] auth.token = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.786904 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.787026 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.787141 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.787255 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.787368 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] credential.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.787481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.787603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.787720 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.787833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.787963 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.788080 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.788204 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.788328 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.788445 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.788558 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.788672 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] credential.caching = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.788788 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.788903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.789025 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.789142 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.789257 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.789377 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.789492 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.789607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.789733 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.789850 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.789964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.790078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.790199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.790314 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.790437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.790553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.790667 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.790781 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.790896 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.791010 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.791136 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.791136 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.791351 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.791466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.791836 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.792018 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.792145 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.792263 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.792378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.792493 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.792608 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.792723 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.792846 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] federation.caching = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.792969 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.793084 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.793199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.793313 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.793427 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.793549 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.793665 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.793787 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.793903 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.794018 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.794124 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.794244 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.794361 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.794481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.794596 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.794710 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.794824 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.795010 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.795129 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.795245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.795359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.795479 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.795593 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.795715 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity.caching = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.795831 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.795971 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.796090 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.796205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.796363 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.796483 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.796598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.796712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.796833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.796833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.797055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.797172 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.797286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.797400 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.797513 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.797626 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.797747 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.797747 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.797970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.798085 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.798085 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.798299 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.798422 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.798537 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.798651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.798765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.798879 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.798993 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.799114 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.799231 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.799231 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.799443 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.799561 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.799676 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.799798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.799933 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.800051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.800165 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.800280 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.800395 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.800520 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.800637 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.800750 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.800864 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.800986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.801101 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.801232 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.801350 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.801465 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.801600 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.801723 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.801839 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.801964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.802086 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.802202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.802315 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.802431 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.802882 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.803014 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.803132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.803247 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.803362 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.803478 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.803592 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.803715 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.803831 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.803986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.804102 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.804218 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.804331 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.804465 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.804583 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.804698 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.804812 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.804927 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.805047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.805171 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.805318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.805435 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.805551 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.805666 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.805780 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.805903 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.806019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.806134 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.806134 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.806356 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.806471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.806595 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.806595 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.806811 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.806931 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.807053 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.807053 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.807284 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.807401 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.807515 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.807515 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.807730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.807730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.808007 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.808123 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.808238 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.808352 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.808466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.808593 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.808711 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.808826 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.808941 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.809062 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.809178 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.809301 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.809421 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.809535 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.809650 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.809765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.809879 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.810055 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.810175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.810290 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.810410 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.810526 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.810647 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.810772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.810888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.811003 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.811117 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.811231 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.811345 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.811468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.811585 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.811699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.811814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.811942 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.812059 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.812187 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.812304 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.812419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.812517 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.812629 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.812744 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.812868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.812985 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.813100 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.813220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.813335 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.813449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.813571 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.813687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.813808 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.813924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.814039 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.814039 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.814261 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.814378 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.814492 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.814606 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.814720 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.814833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.814956 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.815072 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.815186 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.815301 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.815475 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.815596 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.815719 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.815835 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.815974 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.816090 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.816205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.816319 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.816446 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.816593 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.816709 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.816823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.816937 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.817053 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.817175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] resource.caching = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.817291 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.817406 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.817521 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] role.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.817635 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.817749 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] role.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.817944 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.818063 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.818178 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.818293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.818406 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.818520 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.818649 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.818766 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.818880 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.818995 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.819109 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.819227 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.819351 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.819467 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.819581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] role.caching = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.819696 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.819811 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] role.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.819979 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.820110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.820228 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.820343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.820464 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.820612 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.820740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.820857 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.820972 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.821087 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.821201 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.821316 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.821439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.821555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.821670 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.821783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.821898 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.822012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.822135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.822251 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.822366 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.822481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.822595 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.822709 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.822832 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.822949 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.823064 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.823179 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.823293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.823408 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.823531 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.823531 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.823747 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.823861 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.823987 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.824101 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.824228 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.824344 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.824460 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.824574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.824688 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.824803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.824925 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.825042 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.825156 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.825270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.825384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.825499 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.825621 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.825737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] token.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.825851 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.825965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.826079 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.826202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.826317 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.826431 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.826546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.826660 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.826775 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.826898 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.827014 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.827128 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.827241 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.827355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.827468 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.828129 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.828250 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.828364 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.828478 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] token.caching = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.828593 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.828708 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.828830 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.828946 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.829063 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.829178 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.829292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.829406 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.829528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.829644 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.829758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.829872 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.829986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.830100 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.830222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.830338 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.830481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.connection = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.830608 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.830734 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.830850 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.830983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.831099 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.831226 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.831343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.831458 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.831572 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.831686 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.831800 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.831937 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.832056 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.832171 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.832285 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.832399 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.832513 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.832636 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.832752 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.connection = **** {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.832875 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.832999 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.833122 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.833238 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.833352 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.833475 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.833591 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.833706 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.833828 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.833943 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.834057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.834180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.834296 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.834410 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.834801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.834927 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.835044 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.835044 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:46:54.835271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.835271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.835271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.835271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.835271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.835271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.835271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.835271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.835271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.836223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:46:54.836223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:46:54.864410 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:54.864637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:54.864858 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:54.865633 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:54.865870 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:54.866105 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:54.873372 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:54.875156 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:54.902222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:54.902450 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:54.903919 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:54.904163 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:54.956762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:54.957372 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.006671 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.006899 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.008488 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.008730 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.071103 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.071323 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.071546 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.071658 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.071764 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.071849 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.072007 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.072092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.072225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.072322 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.072522 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.072743 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.096507 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.096711 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.096800 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.096927 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.097013 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.097154 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.097238 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.097373 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.097457 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.097585 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.097667 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.097796 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.097889 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.098009 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.111359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.111535 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.124352 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.125085 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.125221 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.125309 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.125881 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.125881 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.126101 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.126183 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.126257 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.126330 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.126403 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.126475 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.126557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.126557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:46:55.144001 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.144212 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 11:46:55.144305 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.144515 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 11:46:55.144849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.144986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 11:46:55.145108 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.145252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.145334 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 11:46:55.145508 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.145591 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.145761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.145842 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.146013 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.146102 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.146306 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.157136 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.157412 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.157678 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.157921 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.158022 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.158211 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.158485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.158769 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.166114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.167029 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.169434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.169712 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.169988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.170265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.170390 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.170664 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.170747 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.170928 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.171010 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.171198 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.171303 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.171498 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.171659 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.171769 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.171998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.172149 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.172233 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.172422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.172504 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.172747 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.175495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.175495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.199680 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.200724 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.201346 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.201629 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.202382 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.203332 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.207603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.207820 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.208124 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.208869 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.209153 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.209440 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.215399 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.215678 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.216804 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.217090 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.220348 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.220631 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.220909 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.221186 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.221461 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.221742 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.221902 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.221987 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.222193 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.222277 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.222480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.222766 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.223043 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.223319 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.223592 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.223864 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.242122 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.242396 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.243634 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.243939 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.246982 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.248583 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.251484 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.251774 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.252876 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.253168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.258215 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.260442 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.261876 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.264224 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.264518 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.264808 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.265790 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.266111 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.266325 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.266417 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.266627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.266916 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.267210 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.267493 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.267796 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.285571 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.285867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.286221 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.286482 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.287447 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.287745 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.288145 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.288417 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.294491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.296744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.297027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.297184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.298877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.299159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.300226 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.300509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.300786 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.301065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.301357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.302261 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.302547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.302833 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.303138 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.303440 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.315514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.315794 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.316099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.316378 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.316667 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.316940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.317216 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.317654 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.317945 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.318234 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.318521 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.318815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.319090 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.319367 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.335443 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.337719 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.338730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.341109 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.342069 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.344206 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.344545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.345872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.346117 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.346198 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.346386 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.347807 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.348114 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.348400 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.353861 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.355460 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.356026 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.357662 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.359210 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.359500 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.359780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.360077 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.361597 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.361897 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.362200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.362480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.370406 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.370695 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.370972 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.372965 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.373256 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.373541 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.379468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.379743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.380051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.380327 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.380613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.380892 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.381173 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.381440 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.381707 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.381978 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.382252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.382429 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:46:55.382513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.382715 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.382805 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.382998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.383083 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.383279 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.383574 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.383852 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.384155 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.384427 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.384707 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.385001 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.385290 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.385589 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.385863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.386148 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:46:55.421733 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5623e5d859c0 pid: 87130 (default app) Jul 14 11:46:55.425155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee37c5-702a-4cf9-94e9-9b98ebaff76f None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:46:55.425453 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee37c5-702a-4cf9-94e9-9b98ebaff76f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:46:55.425702 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5623e5d859c0 pid: 87129 (default app) Jul 14 11:46:55.425786 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee37c5-702a-4cf9-94e9-9b98ebaff76f None None] PATH_INFO: `/v3` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:46:55.429952 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Thu Jul 14 11:46:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:03.505694 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b4268-14ab-4bae-ac6b-a25d731a2c2c None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:03.506229 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b4268-14ab-4bae-ac6b-a25d731a2c2c None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:03.506229 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b4268-14ab-4bae-ac6b-a25d731a2c2c None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:03.510528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:47:03.515718 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de7812-c822-4398-bcc6-87be5dd23f22 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:03.516164 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de7812-c822-4398-bcc6-87be5dd23f22 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:03.516396 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de7812-c822-4398-bcc6-87be5dd23f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:03.596234 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: INFO dbcounter [None req-a7de7812-c822-4398-bcc6-87be5dd23f22 None None] Registered counter for database keystone Jul 14 11:47:03.618900 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG oslo_db.sqlalchemy.engines [None req-a7de7812-c822-4398-bcc6-87be5dd23f22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:47:03.626654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writer thread running {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:47:03.808706 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG passlib.handlers.bcrypt [None req-a7de7812-c822-4398-bcc6-87be5dd23f22 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87130) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 11:47:03.809059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG passlib.handlers.bcrypt [None req-a7de7812-c822-4398-bcc6-87be5dd23f22 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87130) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 11:47:03.864994 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a7de7812-c822-4398-bcc6-87be5dd23f22 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:03.866614 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a7de7812-c822-4398-bcc6-87be5dd23f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:03.991703 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 11:47:04.148498 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b4268-14ab-4bae-ac6b-a25d731a2c2c None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:04.224990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: INFO dbcounter [None req-2b5b4268-14ab-4bae-ac6b-a25d731a2c2c None None] Registered counter for database keystone Jul 14 11:47:04.244171 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG oslo_db.sqlalchemy.engines [None req-2b5b4268-14ab-4bae-ac6b-a25d731a2c2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:47:04.251021 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writer thread running {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:47:04.370479 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b4268-14ab-4bae-ac6b-a25d731a2c2c None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:04.375576 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18581ff-c692-4ae0-98ed-ac1bd8c7926c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:04.376275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18581ff-c692-4ae0-98ed-ac1bd8c7926c admin admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:04.376566 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18581ff-c692-4ae0-98ed-ac1bd8c7926c admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:04.376847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18581ff-c692-4ae0-98ed-ac1bd8c7926c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:04.385548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18581ff-c692-4ae0-98ed-ac1bd8c7926c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:04.438558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f18581ff-c692-4ae0-98ed-ac1bd8c7926c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 11:47:04.438825 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18581ff-c692-4ae0-98ed-ac1bd8c7926c admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:04.449384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Thu Jul 14 11:47:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 11:47:04.455301 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de7812-c822-4398-bcc6-87be5dd23f22 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:04.469897 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de7812-c822-4398-bcc6-87be5dd23f22 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:04.474288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea48883-58a4-4eb4-8dfb-54d57cf93977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:04.475388 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea48883-58a4-4eb4-8dfb-54d57cf93977 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:04.475679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea48883-58a4-4eb4-8dfb-54d57cf93977 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:04.476010 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea48883-58a4-4eb4-8dfb-54d57cf93977 admin admin] PATH_INFO: `/v3/projects/98e8f9ea0c4446b68d2be9ca4901c939` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:04.477588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea48883-58a4-4eb4-8dfb-54d57cf93977 admin admin] RBAC: Authorizing `identity:get_project(project_id=98e8f9ea0c4446b68d2be9ca4901c939)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:04.534405 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4ea48883-58a4-4eb4-8dfb-54d57cf93977 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 11:47:04.535002 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea48883-58a4-4eb4-8dfb-54d57cf93977 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:04.539320 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Thu Jul 14 11:47:04 2022] GET /identity/v3/projects/98e8f9ea0c4446b68d2be9ca4901c939 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:06.771192 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375919a8-6aad-4c19-b370-2f887328be06 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:06.771756 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375919a8-6aad-4c19-b370-2f887328be06 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:06.771756 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375919a8-6aad-4c19-b370-2f887328be06 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:06.775912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:06.782249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad6f65-6b8a-4d5d-aac2-5a97d45b2d2e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:06.782707 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad6f65-6b8a-4d5d-aac2-5a97d45b2d2e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:06.782827 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad6f65-6b8a-4d5d-aac2-5a97d45b2d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:06.801670 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b0ad6f65-6b8a-4d5d-aac2-5a97d45b2d2e None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:06.803229 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b0ad6f65-6b8a-4d5d-aac2-5a97d45b2d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:06.811157 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 11:47:06.836700 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375919a8-6aad-4c19-b370-2f887328be06 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:06.850365 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375919a8-6aad-4c19-b370-2f887328be06 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:06.854675 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ca937-4b41-470d-8767-d8c534cbb656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:06.855322 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ca937-4b41-470d-8767-d8c534cbb656 admin admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:06.855616 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ca937-4b41-470d-8767-d8c534cbb656 admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:06.855986 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ca937-4b41-470d-8767-d8c534cbb656 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:06.864500 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ca937-4b41-470d-8767-d8c534cbb656 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:06.866302 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ca937-4b41-470d-8767-d8c534cbb656 admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:06.875448 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Thu Jul 14 11:47:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:47:06.881436 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad6f65-6b8a-4d5d-aac2-5a97d45b2d2e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:06.891002 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad6f65-6b8a-4d5d-aac2-5a97d45b2d2e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:06.895600 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2012195-7fc4-42a0-95d3-208f53ffdb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:06.896491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2012195-7fc4-42a0-95d3-208f53ffdb21 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:06.896775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2012195-7fc4-42a0-95d3-208f53ffdb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:06.897054 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2012195-7fc4-42a0-95d3-208f53ffdb21 admin admin] PATH_INFO: `/v3/users/e96f467bcdaf40f288963da3024186a8` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:06.898434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2012195-7fc4-42a0-95d3-208f53ffdb21 admin admin] RBAC: Authorizing `identity:get_user(user_id=e96f467bcdaf40f288963da3024186a8)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:06.900295 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2012195-7fc4-42a0-95d3-208f53ffdb21 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:06.901848 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Thu Jul 14 11:47:06 2022] GET /identity/v3/users/e96f467bcdaf40f288963da3024186a8 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:09.198389 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb35d66-837f-422d-8072-9ca1ade9b0fd None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:09.198907 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb35d66-837f-422d-8072-9ca1ade9b0fd None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:09.199010 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb35d66-837f-422d-8072-9ca1ade9b0fd None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:09.200968 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:09.206294 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bce48c-182f-49de-8b13-db7e1c9beb5c None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:09.206743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bce48c-182f-49de-8b13-db7e1c9beb5c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:09.206869 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bce48c-182f-49de-8b13-db7e1c9beb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:09.223657 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-32bce48c-182f-49de-8b13-db7e1c9beb5c None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:09.224891 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-32bce48c-182f-49de-8b13-db7e1c9beb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:09.267695 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b17bda-97fd-4d2d-8511-a39f3eaf23e3 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:09.268023 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b17bda-97fd-4d2d-8511-a39f3eaf23e3 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:09.268314 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b17bda-97fd-4d2d-8511-a39f3eaf23e3 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:09.269678 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:47:09.274979 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef6186-bc94-4d42-8c92-eef5f52aa51e None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:09.275273 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef6186-bc94-4d42-8c92-eef5f52aa51e None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:09.275559 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef6186-bc94-4d42-8c92-eef5f52aa51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:09.304582 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:09.315913 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG passlib.handlers.bcrypt [None req-48ef6186-bc94-4d42-8c92-eef5f52aa51e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87129) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 11:47:09.316348 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG passlib.handlers.bcrypt [None req-48ef6186-bc94-4d42-8c92-eef5f52aa51e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87129) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 11:47:09.329046 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bce48c-182f-49de-8b13-db7e1c9beb5c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:09.351987 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:09.362088 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-48ef6186-bc94-4d42-8c92-eef5f52aa51e None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:09.363769 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-48ef6186-bc94-4d42-8c92-eef5f52aa51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:09.474115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:09.498466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef6186-bc94-4d42-8c92-eef5f52aa51e None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:09.543989 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bce48c-182f-49de-8b13-db7e1c9beb5c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:09.578646 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9215d55-3b3f-42d5-8595-bb456c0bec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:09.579457 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9215d55-3b3f-42d5-8595-bb456c0bec86 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:09.579746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9215d55-3b3f-42d5-8595-bb456c0bec86 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:09.580075 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9215d55-3b3f-42d5-8595-bb456c0bec86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:09.591461 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9215d55-3b3f-42d5-8595-bb456c0bec86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-d9215d55-3b3f-42d5-8595-bb456c0bec86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:09.602890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:09.603815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:09.604672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:09.604672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:09.604672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:09.604672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:09.604672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:09.604672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:09.604672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:09.604672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:09.604672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:09.604672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:09.604672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:09.604672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:09.604672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:47:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:47:09.605854 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef6186-bc94-4d42-8c92-eef5f52aa51e None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:09.607583 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:09.610476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9215d55-3b3f-42d5-8595-bb456c0bec86 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:09.645864 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd3207-650c-4c54-a4df-7c1bc8668c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:09.646786 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd3207-650c-4c54-a4df-7c1bc8668c87 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:09.647075 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd3207-650c-4c54-a4df-7c1bc8668c87 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:09.647369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd3207-650c-4c54-a4df-7c1bc8668c87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:09.699873 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:09.717709 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd3207-650c-4c54-a4df-7c1bc8668c87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:09.718820 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9215d55-3b3f-42d5-8595-bb456c0bec86 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:09.719267 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd3207-650c-4c54-a4df-7c1bc8668c87 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:09.759603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d5bf9-ac98-4f13-94eb-722f5a35388e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:09.760418 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d5bf9-ac98-4f13-94eb-722f5a35388e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:09.760856 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d5bf9-ac98-4f13-94eb-722f5a35388e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:09.761284 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d5bf9-ac98-4f13-94eb-722f5a35388e None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:09.762462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d5bf9-ac98-4f13-94eb-722f5a35388e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:09.762942 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d5bf9-ac98-4f13-94eb-722f5a35388e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:09.765181 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d5bf9-ac98-4f13-94eb-722f5a35388e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:09.781593 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:09.787115 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d5bf9-ac98-4f13-94eb-722f5a35388e None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:09.829010 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:09.834844 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd3207-650c-4c54-a4df-7c1bc8668c87 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:09.837608 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:09.888836 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d5bf9-ac98-4f13-94eb-722f5a35388e None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:09.923517 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2764f51-a47f-4654-a8f6-3a92058e04ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:09.924451 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2764f51-a47f-4654-a8f6-3a92058e04ba None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:09.924735 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2764f51-a47f-4654-a8f6-3a92058e04ba None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:09.925021 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2764f51-a47f-4654-a8f6-3a92058e04ba None admin] PATH_INFO: `/v3/users/e96f467bcdaf40f288963da3024186a8` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:09.926242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2764f51-a47f-4654-a8f6-3a92058e04ba None admin] RBAC: Authorizing `identity:get_user(user_id=e96f467bcdaf40f288963da3024186a8)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:09.927713 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2764f51-a47f-4654-a8f6-3a92058e04ba None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:09.929380 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:09 2022] GET /identity/v3/users/e96f467bcdaf40f288963da3024186a8 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:09.935516 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2764f51-a47f-4654-a8f6-3a92058e04ba None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:09.936853 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd3207-650c-4c54-a4df-7c1bc8668c87 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:09.950115 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:09.972272 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640b6ad-30ed-4353-9338-7e6cc7c74f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:09.973064 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640b6ad-30ed-4353-9338-7e6cc7c74f95 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:09.973352 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640b6ad-30ed-4353-9338-7e6cc7c74f95 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:09.973631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640b6ad-30ed-4353-9338-7e6cc7c74f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:09.992724 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640b6ad-30ed-4353-9338-7e6cc7c74f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:09.994194 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640b6ad-30ed-4353-9338-7e6cc7c74f95 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:10.014886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-b640b6ad-30ed-4353-9338-7e6cc7c74f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:47:10.014886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:10.014886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:10.014886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:10.014886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:10.014886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:10.014886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:10.014886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:10.014886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:10.014886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:10.014886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:10.014886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:10.014886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:47:10.014886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:47:10.014886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:10.015712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:10.016787 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:47:10.016787 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:47:10.016787 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:47:10.016787 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:47:10.016787 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 9/18] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:10.022169 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640b6ad-30ed-4353-9338-7e6cc7c74f95 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:10.036700 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2764f51-a47f-4654-a8f6-3a92058e04ba None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:10.085322 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcd1e4-af83-4de4-bfbf-77e4327bea3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:10.086147 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcd1e4-af83-4de4-bfbf-77e4327bea3d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:10.086428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcd1e4-af83-4de4-bfbf-77e4327bea3d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:10.087884 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcd1e4-af83-4de4-bfbf-77e4327bea3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:10.089302 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcd1e4-af83-4de4-bfbf-77e4327bea3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:10.091419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcd1e4-af83-4de4-bfbf-77e4327bea3d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:10.092254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:10.093301 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 10/19] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:10.099608 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcd1e4-af83-4de4-bfbf-77e4327bea3d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:10.146723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640b6ad-30ed-4353-9338-7e6cc7c74f95 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:10.182531 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895ff24-12b8-4c14-b883-4adfb0f087e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:10.183305 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895ff24-12b8-4c14-b883-4adfb0f087e1 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:10.183606 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895ff24-12b8-4c14-b883-4adfb0f087e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:10.183898 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895ff24-12b8-4c14-b883-4adfb0f087e1 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:10.184645 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895ff24-12b8-4c14-b883-4adfb0f087e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:10.184960 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895ff24-12b8-4c14-b883-4adfb0f087e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:10.185826 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:10.186750 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895ff24-12b8-4c14-b883-4adfb0f087e1 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:10.206341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcd1e4-af83-4de4-bfbf-77e4327bea3d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:10.243435 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a8acc-631a-4150-87f8-beb8ba52e70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:10.244149 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a8acc-631a-4150-87f8-beb8ba52e70e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:10.244439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a8acc-631a-4150-87f8-beb8ba52e70e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:10.244721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a8acc-631a-4150-87f8-beb8ba52e70e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:10.245576 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a8acc-631a-4150-87f8-beb8ba52e70e None admin] RBAC: Adding query filter params (role.id=321ee52ce1bc4eafa201f23f55f23d2b, scope.domain.id=default, user.id=e96f467bcdaf40f288963da3024186a8) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:10.245928 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a8acc-631a-4150-87f8-beb8ba52e70e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:10.247936 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a8acc-631a-4150-87f8-beb8ba52e70e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:10.255613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Thu Jul 14 11:47:10 2022] GET /identity/v3/role_assignments?user.id=e96f467bcdaf40f288963da3024186a8&scope.domain.id=default&role.id=321ee52ce1bc4eafa201f23f55f23d2b => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:10.314861 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:12.925045 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927e242-bde2-4f8a-8dec-1e9480842e98 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:12.925577 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927e242-bde2-4f8a-8dec-1e9480842e98 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:12.925656 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927e242-bde2-4f8a-8dec-1e9480842e98 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:12.926961 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:12.935282 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa84c97-5219-4451-b4cc-7bc15dc822fb None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:12.935721 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa84c97-5219-4451-b4cc-7bc15dc822fb None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:12.935917 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa84c97-5219-4451-b4cc-7bc15dc822fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:12.960083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-daa84c97-5219-4451-b4cc-7bc15dc822fb None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:12.961299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-daa84c97-5219-4451-b4cc-7bc15dc822fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:13.057566 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f3ac1-60f6-4259-89dd-965f3035a933 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:13.057962 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f3ac1-60f6-4259-89dd-965f3035a933 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:13.058126 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f3ac1-60f6-4259-89dd-965f3035a933 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:13.059571 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 13/23] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:13.062077 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 11/24] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 14 11:47:13.066129 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7938a-fc89-4241-92be-a848e608dbd9 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:13.066414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7938a-fc89-4241-92be-a848e608dbd9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:13.066701 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7938a-fc89-4241-92be-a848e608dbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:13.090552 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b4d7938a-fc89-4241-92be-a848e608dbd9 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:13.091755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b4d7938a-fc89-4241-92be-a848e608dbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:13.149218 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa84c97-5219-4451-b4cc-7bc15dc822fb None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:13.210165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 14/25] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:13.255741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7938a-fc89-4241-92be-a848e608dbd9 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:13.259033 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:13.360648 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa84c97-5219-4451-b4cc-7bc15dc822fb None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:13.396265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:13.397834 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f7492-b1fc-4fd1-8db6-00173ebf8f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:13.398831 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f7492-b1fc-4fd1-8db6-00173ebf8f16 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:13.399245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f7492-b1fc-4fd1-8db6-00173ebf8f16 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:13.399659 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f7492-b1fc-4fd1-8db6-00173ebf8f16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:13.411414 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f7492-b1fc-4fd1-8db6-00173ebf8f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:13.413165 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f7492-b1fc-4fd1-8db6-00173ebf8f16 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:13.434168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-193f7492-b1fc-4fd1-8db6-00173ebf8f16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:47:13.434168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:13.434168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:13.434168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:13.434168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:13.434168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:13.434168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:13.434168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:13.434168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:13.434168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:13.434168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:13.434168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:13.434168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:47:13.434168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:47:13.434168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:13.435008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:13.435817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:47:13.435817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:47:13.435817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:47:13.435817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:47:13.437987 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 12/26] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:47:13.439542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe408a-9f7a-4472-99d8-5bfffde841f6 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:13.440069 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe408a-9f7a-4472-99d8-5bfffde841f6 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:13.440521 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe408a-9f7a-4472-99d8-5bfffde841f6 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:13.442010 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:13.447015 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe408a-9f7a-4472-99d8-5bfffde841f6 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:13.466540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7938a-fc89-4241-92be-a848e608dbd9 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:13.513928 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037f80e-803c-4e85-8e5c-3be108f6e3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:13.515295 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037f80e-803c-4e85-8e5c-3be108f6e3cd None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:13.516106 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037f80e-803c-4e85-8e5c-3be108f6e3cd None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:13.516633 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037f80e-803c-4e85-8e5c-3be108f6e3cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:13.529856 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037f80e-803c-4e85-8e5c-3be108f6e3cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-d037f80e-803c-4e85-8e5c-3be108f6e3cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:13.546874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:13.547743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:13.548522 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:13.548522 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:13.548522 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:13.548522 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:13.548522 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:13.548522 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:13.548522 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:13.548522 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:13.548522 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:13.548522 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:13.548522 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:13.548522 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:13.550640 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 15/28] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:47:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:47:13.555782 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a023d3-21b5-463f-8af2-b3f79b49655e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:13.556295 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a023d3-21b5-463f-8af2-b3f79b49655e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:13.556725 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a023d3-21b5-463f-8af2-b3f79b49655e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:13.585666 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-53a023d3-21b5-463f-8af2-b3f79b49655e None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:13.587330 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-53a023d3-21b5-463f-8af2-b3f79b49655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:13.600581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:13.612474 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe408a-9f7a-4472-99d8-5bfffde841f6 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:13.669181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabdb53-ab04-49d9-a988-c33643276ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:13.670231 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabdb53-ab04-49d9-a988-c33643276ec9 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:13.670735 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabdb53-ab04-49d9-a988-c33643276ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:13.671208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabdb53-ab04-49d9-a988-c33643276ec9 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:13.672186 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabdb53-ab04-49d9-a988-c33643276ec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:13.672708 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabdb53-ab04-49d9-a988-c33643276ec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:13.674289 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabdb53-ab04-49d9-a988-c33643276ec9 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:13.690436 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 14/29] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:13.693981 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabdb53-ab04-49d9-a988-c33643276ec9 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:13.738763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 16/30] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:13.740199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a023d3-21b5-463f-8af2-b3f79b49655e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:13.825735 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:13.829277 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabdb53-ab04-49d9-a988-c33643276ec9 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:13.867157 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a023d3-21b5-463f-8af2-b3f79b49655e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:13.870521 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75834b80-a821-4a13-b52f-cab1355104e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:13.871304 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75834b80-a821-4a13-b52f-cab1355104e0 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:13.871591 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75834b80-a821-4a13-b52f-cab1355104e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:13.871872 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75834b80-a821-4a13-b52f-cab1355104e0 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:13.872698 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75834b80-a821-4a13-b52f-cab1355104e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:13.873012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75834b80-a821-4a13-b52f-cab1355104e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:13.874413 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75834b80-a821-4a13-b52f-cab1355104e0 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:13.900383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 15/31] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:13.900383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a27e7-04c3-42c7-8b4a-56ecbf2c8c61 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:13.900383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a27e7-04c3-42c7-8b4a-56ecbf2c8c61 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:13.900383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a27e7-04c3-42c7-8b4a-56ecbf2c8c61 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:13.900383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 16/32] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:13.900383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a27e7-04c3-42c7-8b4a-56ecbf2c8c61 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:13.918414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7940c08-9868-4dd2-b2ee-441af003d501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:13.919434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7940c08-9868-4dd2-b2ee-441af003d501 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:13.919985 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7940c08-9868-4dd2-b2ee-441af003d501 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:13.920607 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7940c08-9868-4dd2-b2ee-441af003d501 None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:13.921649 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7940c08-9868-4dd2-b2ee-441af003d501 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:13.923333 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7940c08-9868-4dd2-b2ee-441af003d501 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:13.924507 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:14.014567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a27e7-04c3-42c7-8b4a-56ecbf2c8c61 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:14.052430 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ff2fc-6643-4413-a870-28f2399121ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:14.053133 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ff2fc-6643-4413-a870-28f2399121ae None admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:14.053421 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ff2fc-6643-4413-a870-28f2399121ae None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:14.053700 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ff2fc-6643-4413-a870-28f2399121ae None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:14.054453 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ff2fc-6643-4413-a870-28f2399121ae None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:14.055817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ff2fc-6643-4413-a870-28f2399121ae None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:14.092734 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 17/33] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 14 11:47:13 2022] POST /identity/v3/projects => generated 301 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:47:14.095123 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e25d3-febe-4d44-a085-b37767ed9925 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:14.095628 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e25d3-febe-4d44-a085-b37767ed9925 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:14.096140 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e25d3-febe-4d44-a085-b37767ed9925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:14.115392 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-035e25d3-febe-4d44-a085-b37767ed9925 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:14.117307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-035e25d3-febe-4d44-a085-b37767ed9925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:14.202310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 17/34] 10.222.0.49 () {60 vars in 1131 bytes} [Thu Jul 14 11:47:13 2022] POST /identity/v3/roles => generated 219 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:47:14.203400 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ff2fc-6643-4413-a870-28f2399121ae None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:14.222694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 18/35] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:14.263726 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e25d3-febe-4d44-a085-b37767ed9925 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:14.312518 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:14.331097 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ff2fc-6643-4413-a870-28f2399121ae None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:14.361400 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:14.375095 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c548ee-7c84-4ca5-bb2d-3cf7672d193f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:14.375843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c548ee-7c84-4ca5-bb2d-3cf7672d193f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:14.376165 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c548ee-7c84-4ca5-bb2d-3cf7672d193f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:14.376503 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c548ee-7c84-4ca5-bb2d-3cf7672d193f None admin] PATH_INFO: `/v3/users/e96f467bcdaf40f288963da3024186a8` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:14.379485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c548ee-7c84-4ca5-bb2d-3cf7672d193f None admin] RBAC: Authorizing `identity:get_user(user_id=e96f467bcdaf40f288963da3024186a8)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:14.381165 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c548ee-7c84-4ca5-bb2d-3cf7672d193f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:14.383111 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 18/36] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:14 2022] GET /identity/v3/users/e96f467bcdaf40f288963da3024186a8 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:14.389908 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c548ee-7c84-4ca5-bb2d-3cf7672d193f None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:14.436588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e25d3-febe-4d44-a085-b37767ed9925 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:14.478692 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a3ce6-20ce-48e5-b0cf-cf826d5586e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:14.480874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a3ce6-20ce-48e5-b0cf-cf826d5586e3 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:14.481414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a3ce6-20ce-48e5-b0cf-cf826d5586e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:14.481922 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a3ce6-20ce-48e5-b0cf-cf826d5586e3 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:14.483011 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a3ce6-20ce-48e5-b0cf-cf826d5586e3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:14.484947 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a3ce6-20ce-48e5-b0cf-cf826d5586e3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:14.504260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 19/37] 10.222.0.49 () {60 vars in 1131 bytes} [Thu Jul 14 11:47:14 2022] POST /identity/v3/roles => generated 225 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:47:14.511094 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c548ee-7c84-4ca5-bb2d-3cf7672d193f None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:14.561820 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fe851-f63d-4c69-a467-52110235b0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:14.562705 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fe851-f63d-4c69-a467-52110235b0f2 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:14.562938 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fe851-f63d-4c69-a467-52110235b0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:14.563222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fe851-f63d-4c69-a467-52110235b0f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:14.568484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fe851-f63d-4c69-a467-52110235b0f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:14.570126 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fe851-f63d-4c69-a467-52110235b0f2 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:14.571988 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 19/38] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:14.578779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a3ce6-20ce-48e5-b0cf-cf826d5586e3 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:14.731298 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a3ce6-20ce-48e5-b0cf-cf826d5586e3 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:14.742747 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:14.776775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad3525-3a59-45b5-825c-885f8457ab48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:14.777678 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad3525-3a59-45b5-825c-885f8457ab48 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:14.777971 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad3525-3a59-45b5-825c-885f8457ab48 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:14.778256 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad3525-3a59-45b5-825c-885f8457ab48 None admin] PATH_INFO: `/v3/domains/default/users/e96f467bcdaf40f288963da3024186a8/roles/321ee52ce1bc4eafa201f23f55f23d2b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:14.780373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad3525-3a59-45b5-825c-885f8457ab48 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e96f467bcdaf40f288963da3024186a8, role_id=321ee52ce1bc4eafa201f23f55f23d2b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:14.781864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad3525-3a59-45b5-825c-885f8457ab48 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:14.793716 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0ccda-4a77-42e8-97f1-7975aed4907f None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:14.794094 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0ccda-4a77-42e8-97f1-7975aed4907f None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:14.794323 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0ccda-4a77-42e8-97f1-7975aed4907f None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:14.795758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 20/39] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:14.800734 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 20/40] 10.222.0.49 () {58 vars in 1361 bytes} [Thu Jul 14 11:47:14 2022] PUT /identity/v3/domains/default/users/e96f467bcdaf40f288963da3024186a8/roles/321ee52ce1bc4eafa201f23f55f23d2b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:47:14.801084 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb7628-7995-43ea-a02a-bcdf98025142 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:14.801382 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb7628-7995-43ea-a02a-bcdf98025142 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:14.801713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb7628-7995-43ea-a02a-bcdf98025142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:14.821668 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-e1fb7628-7995-43ea-a02a-bcdf98025142 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:14.823725 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-e1fb7628-7995-43ea-a02a-bcdf98025142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:14.837463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:14.895476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20405bd7-6b1b-40c2-b729-fedca9220af9 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:14.895781 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20405bd7-6b1b-40c2-b729-fedca9220af9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:14.896097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20405bd7-6b1b-40c2-b729-fedca9220af9 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:14.897483 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 21/41] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:47:14.904397 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcd48e-0dac-4f0c-a591-e82147481d71 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:14.904701 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcd48e-0dac-4f0c-a591-e82147481d71 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:14.904985 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcd48e-0dac-4f0c-a591-e82147481d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:14.913481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 21/42] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:14.923421 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0bfcd48e-0dac-4f0c-a591-e82147481d71 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:14.924714 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0bfcd48e-0dac-4f0c-a591-e82147481d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:14.937523 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb7628-7995-43ea-a02a-bcdf98025142 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:15.006095 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 22/43] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:15.032327 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcd48e-0dac-4f0c-a591-e82147481d71 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:15.049396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb7628-7995-43ea-a02a-bcdf98025142 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:15.086457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570b74e-e7f4-4aaa-80e2-6751815a33ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:15.087292 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570b74e-e7f4-4aaa-80e2-6751815a33ae None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:15.087594 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570b74e-e7f4-4aaa-80e2-6751815a33ae None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:15.087880 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570b74e-e7f4-4aaa-80e2-6751815a33ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:15.089809 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570b74e-e7f4-4aaa-80e2-6751815a33ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:15.091299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570b74e-e7f4-4aaa-80e2-6751815a33ae None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:15.092967 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 22/44] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:15.098372 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570b74e-e7f4-4aaa-80e2-6751815a33ae None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:15.115418 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:15.136445 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:15.143742 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcd48e-0dac-4f0c-a591-e82147481d71 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:15.184180 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d85c11-a4ac-4e33-8ca1-23f07cf86754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:15.184868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d85c11-a4ac-4e33-8ca1-23f07cf86754 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:15.185157 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d85c11-a4ac-4e33-8ca1-23f07cf86754 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:15.185438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d85c11-a4ac-4e33-8ca1-23f07cf86754 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:15.186190 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d85c11-a4ac-4e33-8ca1-23f07cf86754 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:15.187620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d85c11-a4ac-4e33-8ca1-23f07cf86754 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:15.203941 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 23/45] 10.222.0.49 () {60 vars in 1131 bytes} [Thu Jul 14 11:47:15 2022] POST /identity/v3/roles => generated 223 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:47:15.228200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570b74e-e7f4-4aaa-80e2-6751815a33ae None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:15.268387 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6c277-d69d-4b30-bf21-85cf8364f1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:15.269111 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6c277-d69d-4b30-bf21-85cf8364f1d6 None admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:15.269402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6c277-d69d-4b30-bf21-85cf8364f1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:15.269684 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6c277-d69d-4b30-bf21-85cf8364f1d6 None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:15.270417 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6c277-d69d-4b30-bf21-85cf8364f1d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:15.271918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6c277-d69d-4b30-bf21-85cf8364f1d6 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:15.302434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 23/46] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 14 11:47:15 2022] POST /identity/v3/projects => generated 312 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:47:17.062767 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176086e-5774-4721-b6a6-6d722ee6be42 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:17.063282 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176086e-5774-4721-b6a6-6d722ee6be42 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:17.063391 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176086e-5774-4721-b6a6-6d722ee6be42 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:17.064722 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 24/47] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:17.070179 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fdb94-dae2-41f7-a634-fea416764735 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:17.070580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fdb94-dae2-41f7-a634-fea416764735 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:17.070824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fdb94-dae2-41f7-a634-fea416764735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:17.087914 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-5b9fdb94-dae2-41f7-a634-fea416764735 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:17.089133 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-5b9fdb94-dae2-41f7-a634-fea416764735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:17.151496 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:17.160241 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 24/48] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:17.185701 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176086e-5774-4721-b6a6-6d722ee6be42 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:17.286288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176086e-5774-4721-b6a6-6d722ee6be42 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:17.320048 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23c3d7-7ed2-4bf4-9c89-c8efa0079210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:17.320772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23c3d7-7ed2-4bf4-9c89-c8efa0079210 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:17.321061 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23c3d7-7ed2-4bf4-9c89-c8efa0079210 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:17.321340 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23c3d7-7ed2-4bf4-9c89-c8efa0079210 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:17.331985 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23c3d7-7ed2-4bf4-9c89-c8efa0079210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-3a23c3d7-7ed2-4bf4-9c89-c8efa0079210 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:17.340325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:17.341360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:17.342120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:17.342120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:17.342120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:17.342120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:17.342120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:17.342120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:17.342120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:17.342120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:17.342120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:17.342120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:17.342120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:17.342120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:17.342120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 25/49] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:47:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:17.347330 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fdb94-dae2-41f7-a634-fea416764735 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:17.447776 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fdb94-dae2-41f7-a634-fea416764735 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:17.488065 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb9e02-2f4e-42b8-89eb-48f38c630fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:17.488754 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb9e02-2f4e-42b8-89eb-48f38c630fbc None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:17.489041 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb9e02-2f4e-42b8-89eb-48f38c630fbc None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:17.489323 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb9e02-2f4e-42b8-89eb-48f38c630fbc None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:17.490091 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb9e02-2f4e-42b8-89eb-48f38c630fbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:17.490405 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb9e02-2f4e-42b8-89eb-48f38c630fbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:17.491845 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb9e02-2f4e-42b8-89eb-48f38c630fbc None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:17.501342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 25/50] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:17.506960 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23c3d7-7ed2-4bf4-9c89-c8efa0079210 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:17.526629 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:17.609192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23c3d7-7ed2-4bf4-9c89-c8efa0079210 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:17.632708 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047967b-7f50-4fe0-bb23-ed22b213ab21 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:17.633010 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047967b-7f50-4fe0-bb23-ed22b213ab21 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:17.633298 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047967b-7f50-4fe0-bb23-ed22b213ab21 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:17.634965 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 26/51] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:47:17.640305 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961de991-bbb7-4c50-866a-4a6672cf2e2c None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:17.640596 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961de991-bbb7-4c50-866a-4a6672cf2e2c None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:17.640879 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961de991-bbb7-4c50-866a-4a6672cf2e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:17.645473 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642d102-cc45-49d5-8d27-a05f15ced1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:17.646359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642d102-cc45-49d5-8d27-a05f15ced1ef None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:17.646665 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642d102-cc45-49d5-8d27-a05f15ced1ef None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:17.646941 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642d102-cc45-49d5-8d27-a05f15ced1ef None admin] PATH_INFO: `/v3/users/e96f467bcdaf40f288963da3024186a8` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:17.648184 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642d102-cc45-49d5-8d27-a05f15ced1ef None admin] RBAC: Authorizing `identity:get_user(user_id=e96f467bcdaf40f288963da3024186a8)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:17.649659 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642d102-cc45-49d5-8d27-a05f15ced1ef None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:17.652594 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 26/52] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:17 2022] GET /identity/v3/users/e96f467bcdaf40f288963da3024186a8 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:17.657729 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642d102-cc45-49d5-8d27-a05f15ced1ef None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:17.658301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-961de991-bbb7-4c50-866a-4a6672cf2e2c None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:17.659608 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-961de991-bbb7-4c50-866a-4a6672cf2e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:17.714907 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:17.730027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 27/53] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:17.746543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:17.758667 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961de991-bbb7-4c50-866a-4a6672cf2e2c None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:17.764785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642d102-cc45-49d5-8d27-a05f15ced1ef None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:17.803357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb8c41-2d03-4b13-bcc0-4a15c950d6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:17.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb8c41-2d03-4b13-bcc0-4a15c950d6cf None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:17.804486 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb8c41-2d03-4b13-bcc0-4a15c950d6cf None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:17.804765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb8c41-2d03-4b13-bcc0-4a15c950d6cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:17.805970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb8c41-2d03-4b13-bcc0-4a15c950d6cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:17.808205 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb8c41-2d03-4b13-bcc0-4a15c950d6cf None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:17.809859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 27/54] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:17.815853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb8c41-2d03-4b13-bcc0-4a15c950d6cf None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:17.862367 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961de991-bbb7-4c50-866a-4a6672cf2e2c None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:17.897331 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03002349-b35d-4ffa-8513-f0d38ae7b82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:17.898129 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03002349-b35d-4ffa-8513-f0d38ae7b82f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:17.898413 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03002349-b35d-4ffa-8513-f0d38ae7b82f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:17.898693 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03002349-b35d-4ffa-8513-f0d38ae7b82f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:17.899867 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03002349-b35d-4ffa-8513-f0d38ae7b82f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:17.901395 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03002349-b35d-4ffa-8513-f0d38ae7b82f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:17.903013 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 28/55] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:17.908570 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03002349-b35d-4ffa-8513-f0d38ae7b82f None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:17.919678 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb8c41-2d03-4b13-bcc0-4a15c950d6cf None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:17.952917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fba07f-0962-4f09-859c-0c6f2424a55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:17.953575 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fba07f-0962-4f09-859c-0c6f2424a55f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:17.953884 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fba07f-0962-4f09-859c-0c6f2424a55f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:17.954156 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fba07f-0962-4f09-859c-0c6f2424a55f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:17.955016 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fba07f-0962-4f09-859c-0c6f2424a55f None admin] RBAC: Adding query filter params (role.id=321ee52ce1bc4eafa201f23f55f23d2b, scope.domain.id=default, user.id=e96f467bcdaf40f288963da3024186a8) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:17.955332 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fba07f-0962-4f09-859c-0c6f2424a55f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:17.956817 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fba07f-0962-4f09-859c-0c6f2424a55f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:17.962671 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 28/56] 10.222.0.49 () {56 vars in 1322 bytes} [Thu Jul 14 11:47:17 2022] GET /identity/v3/role_assignments?user.id=e96f467bcdaf40f288963da3024186a8&scope.domain.id=default&role.id=321ee52ce1bc4eafa201f23f55f23d2b => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:17.964165 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:18.017676 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03002349-b35d-4ffa-8513-f0d38ae7b82f None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:18.054917 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824718ad-62dd-4461-adfa-ce333ae2ec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:18.055600 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824718ad-62dd-4461-adfa-ce333ae2ec1b None admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:18.055917 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824718ad-62dd-4461-adfa-ce333ae2ec1b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:18.056210 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824718ad-62dd-4461-adfa-ce333ae2ec1b None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:18.056978 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824718ad-62dd-4461-adfa-ce333ae2ec1b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:18.058477 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824718ad-62dd-4461-adfa-ce333ae2ec1b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:18.089813 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 29/57] 10.222.0.49 () {60 vars in 1140 bytes} [Thu Jul 14 11:47:17 2022] POST /identity/v3/projects => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:47:20.381570 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ce847-d75a-4129-b8ad-f636da84a793 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:20.382111 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ce847-d75a-4129-b8ad-f636da84a793 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:20.382111 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ce847-d75a-4129-b8ad-f636da84a793 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:20.383487 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 29/58] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:20.388741 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382d9c6-9dbe-492f-938b-4c069fe83f58 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:20.389385 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382d9c6-9dbe-492f-938b-4c069fe83f58 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:20.389575 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382d9c6-9dbe-492f-938b-4c069fe83f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:20.406024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-e382d9c6-9dbe-492f-938b-4c069fe83f58 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:20.407214 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-e382d9c6-9dbe-492f-938b-4c069fe83f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:20.475176 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 30/59] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:20.502260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ce847-d75a-4129-b8ad-f636da84a793 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:20.520878 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:20.611038 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ce847-d75a-4129-b8ad-f636da84a793 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:20.643568 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50225804-5420-4692-b3f5-61fee83cb4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:20.644387 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50225804-5420-4692-b3f5-61fee83cb4f7 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:20.644679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50225804-5420-4692-b3f5-61fee83cb4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:20.644962 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50225804-5420-4692-b3f5-61fee83cb4f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:20.646135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50225804-5420-4692-b3f5-61fee83cb4f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:20.647596 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50225804-5420-4692-b3f5-61fee83cb4f7 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:20.649238 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 30/60] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:20.655623 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382d9c6-9dbe-492f-938b-4c069fe83f58 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:20.695401 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:20.756426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382d9c6-9dbe-492f-938b-4c069fe83f58 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:20.790841 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a5d79-63a5-4813-a6e7-217b929d7dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:20.791584 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a5d79-63a5-4813-a6e7-217b929d7dfb None admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:20.791882 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a5d79-63a5-4813-a6e7-217b929d7dfb None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:20.792198 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a5d79-63a5-4813-a6e7-217b929d7dfb None admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:20.792906 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a5d79-63a5-4813-a6e7-217b929d7dfb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:20.794370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a5d79-63a5-4813-a6e7-217b929d7dfb None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:20.819518 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 31/61] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 14 11:47:20 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:47:24.426230 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d162f-9e02-4f91-b4c9-4b7a525148f2 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:24.427137 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d162f-9e02-4f91-b4c9-4b7a525148f2 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:24.427577 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d162f-9e02-4f91-b4c9-4b7a525148f2 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:24.429148 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 31/62] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:24.435383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2a1c4-11e7-488d-9050-4c291bceed55 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:24.435826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2a1c4-11e7-488d-9050-4c291bceed55 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:24.436171 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2a1c4-11e7-488d-9050-4c291bceed55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:24.457754 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-c6f2a1c4-11e7-488d-9050-4c291bceed55 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:24.459389 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-c6f2a1c4-11e7-488d-9050-4c291bceed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:24.531747 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc84d30-4d9b-4b84-849c-49be583d90c7 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:24.531747 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc84d30-4d9b-4b84-849c-49be583d90c7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:24.531747 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc84d30-4d9b-4b84-849c-49be583d90c7 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:24.531747 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 32/63] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:24.538266 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d355a96-847c-487e-9545-2999e013f71d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:24.538811 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d355a96-847c-487e-9545-2999e013f71d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:24.539940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d355a96-847c-487e-9545-2999e013f71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:24.561061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 32/64] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:24.580989 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0d355a96-847c-487e-9545-2999e013f71d None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:24.582316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0d355a96-847c-487e-9545-2999e013f71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:24.591767 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2a1c4-11e7-488d-9050-4c291bceed55 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:24.639602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:24.684683 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 33/65] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:24.693407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691be61-ccae-4935-ac68-a0a14f46dfed None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:24.693867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691be61-ccae-4935-ac68-a0a14f46dfed None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:24.694355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691be61-ccae-4935-ac68-a0a14f46dfed None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:24.696037 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 34/66] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:24.702627 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84ba31-e12c-4d32-8b64-412547149822 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:24.703099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84ba31-e12c-4d32-8b64-412547149822 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:24.703528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84ba31-e12c-4d32-8b64-412547149822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:24.733550 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-2d84ba31-e12c-4d32-8b64-412547149822 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:24.733759 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2a1c4-11e7-488d-9050-4c291bceed55 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:24.735171 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-2d84ba31-e12c-4d32-8b64-412547149822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:24.748175 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:24.773515 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f447a-b908-49a0-a0e1-0239311dbf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:24.774697 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f447a-b908-49a0-a0e1-0239311dbf48 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:24.774997 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f447a-b908-49a0-a0e1-0239311dbf48 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:24.775280 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f447a-b908-49a0-a0e1-0239311dbf48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:24.787556 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f447a-b908-49a0-a0e1-0239311dbf48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-bd5f447a-b908-49a0-a0e1-0239311dbf48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:24.797996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:24.799073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:24.800035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:24.800035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:24.800035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:24.800035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:24.800035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:24.800035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:24.800035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:24.800035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:24.800035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:24.800035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:24.800035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:24.800035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:47:24.800035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 33/67] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:47:24.800776 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f447a-b908-49a0-a0e1-0239311dbf48 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:24.821398 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 35/68] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:24.823086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99442646-d937-4230-872a-d268b2be9152 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:24.823385 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99442646-d937-4230-872a-d268b2be9152 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:24.823804 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99442646-d937-4230-872a-d268b2be9152 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:24.825244 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 36/69] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:24.826044 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99442646-d937-4230-872a-d268b2be9152 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:24.917411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:24.936859 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f447a-b908-49a0-a0e1-0239311dbf48 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:24.949008 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99442646-d937-4230-872a-d268b2be9152 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:24.972273 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b0b36-f1e3-4e8a-92b3-f2b24528d420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:24.973072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b0b36-f1e3-4e8a-92b3-f2b24528d420 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:24.973367 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b0b36-f1e3-4e8a-92b3-f2b24528d420 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:24.973653 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b0b36-f1e3-4e8a-92b3-f2b24528d420 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:24.984759 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b0b36-f1e3-4e8a-92b3-f2b24528d420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:24.988505 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b5e4d-cdb2-41a5-a346-357cba56128e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:24.989178 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b5e4d-cdb2-41a5-a346-357cba56128e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:24.989466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b5e4d-cdb2-41a5-a346-357cba56128e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:24.989747 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b5e4d-cdb2-41a5-a346-357cba56128e None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:24.990498 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b5e4d-cdb2-41a5-a346-357cba56128e None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:24.990815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b5e4d-cdb2-41a5-a346-357cba56128e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:24.992261 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b5e4d-cdb2-41a5-a346-357cba56128e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-0a1b0b36-f1e3-4e8a-92b3-f2b24528d420 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:24.992602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:24.993814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:24.994546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:24.994546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:24.994546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:24.994546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:24.994546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:24.994546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:24.994546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:24.994546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:24.994546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:24.994546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:24.994546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:24.994546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:47:24.994546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 34/70] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:47:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:24.995179 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5611e-bbfb-44a5-b7e4-075b9a809271 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:24.995472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5611e-bbfb-44a5-b7e4-075b9a809271 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:24.995766 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5611e-bbfb-44a5-b7e4-075b9a809271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:25.005667 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 37/71] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:25.006689 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b5e4d-cdb2-41a5-a346-357cba56128e None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:25.016011 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-d8f5611e-bbfb-44a5-b7e4-075b9a809271 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:25.016780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:25.017346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-d8f5611e-bbfb-44a5-b7e4-075b9a809271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:25.084290 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 35/72] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:25.085866 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173142d0-fdc5-45ba-b04a-49d875eb30e6 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:25.086688 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173142d0-fdc5-45ba-b04a-49d875eb30e6 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:25.087297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173142d0-fdc5-45ba-b04a-49d875eb30e6 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:25.088282 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 36/73] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:25.088993 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173142d0-fdc5-45ba-b04a-49d875eb30e6 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:25.122516 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b5e4d-cdb2-41a5-a346-357cba56128e None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:25.157555 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2231f1-8244-40fd-afaa-93ddaef003e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:25.158369 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2231f1-8244-40fd-afaa-93ddaef003e2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:25.158664 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2231f1-8244-40fd-afaa-93ddaef003e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:25.158953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2231f1-8244-40fd-afaa-93ddaef003e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:25.168485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:25.169770 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2231f1-8244-40fd-afaa-93ddaef003e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-1b2231f1-8244-40fd-afaa-93ddaef003e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:25.178336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:25.179211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:25.180051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:25.180051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:25.180051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:25.180051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:25.180051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:25.180051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:25.180051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:25.180051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:25.180051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:25.180051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:25.180051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:47:25.180051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:25.180051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 38/74] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:47:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:25.180816 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2231f1-8244-40fd-afaa-93ddaef003e2 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:25.202515 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173142d0-fdc5-45ba-b04a-49d875eb30e6 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:25.239559 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24551a9-3c0f-4223-b8e3-d934edef5b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:25.240268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24551a9-3c0f-4223-b8e3-d934edef5b24 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:25.240560 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24551a9-3c0f-4223-b8e3-d934edef5b24 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:25.240837 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24551a9-3c0f-4223-b8e3-d934edef5b24 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:25.241594 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24551a9-3c0f-4223-b8e3-d934edef5b24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:25.242147 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24551a9-3c0f-4223-b8e3-d934edef5b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:25.244761 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24551a9-3c0f-4223-b8e3-d934edef5b24 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:25.247664 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:25.257032 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:25.259127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bd773-2a6b-47b4-8942-aad37ad0379e None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:25.259571 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bd773-2a6b-47b4-8942-aad37ad0379e None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:25.260027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bd773-2a6b-47b4-8942-aad37ad0379e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:25.283319 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-ae2bd773-2a6b-47b4-8942-aad37ad0379e None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:25.284940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-ae2bd773-2a6b-47b4-8942-aad37ad0379e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:25.288565 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2231f1-8244-40fd-afaa-93ddaef003e2 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:25.325871 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcc103-ac04-4615-9546-5ccfb0736fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:25.326757 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcc103-ac04-4615-9546-5ccfb0736fc7 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:25.327047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcc103-ac04-4615-9546-5ccfb0736fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:25.327324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcc103-ac04-4615-9546-5ccfb0736fc7 None admin] PATH_INFO: `/v3/users/9c838dd213e94d348715998fbd4b45b9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:25.341542 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcc103-ac04-4615-9546-5ccfb0736fc7 None admin] RBAC: Authorizing `identity:get_user(user_id=9c838dd213e94d348715998fbd4b45b9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:25.343038 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcc103-ac04-4615-9546-5ccfb0736fc7 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:25.344756 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 39/76] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:25 2022] GET /identity/v3/users/9c838dd213e94d348715998fbd4b45b9 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:25.348708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcc103-ac04-4615-9546-5ccfb0736fc7 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:25.360975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 38/77] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:25.361836 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bd773-2a6b-47b4-8942-aad37ad0379e None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:25.428169 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:25.454685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcc103-ac04-4615-9546-5ccfb0736fc7 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:25.464577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bd773-2a6b-47b4-8942-aad37ad0379e None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:25.479220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:25.490456 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26865a9-c1e1-42bf-967c-4904bfbaabd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:25.491264 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26865a9-c1e1-42bf-967c-4904bfbaabd5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:25.491554 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26865a9-c1e1-42bf-967c-4904bfbaabd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:25.491836 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26865a9-c1e1-42bf-967c-4904bfbaabd5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:25.498178 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05cb65-cc7d-4de2-af61-0a94aea77928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:25.498852 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05cb65-cc7d-4de2-af61-0a94aea77928 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:25.499138 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05cb65-cc7d-4de2-af61-0a94aea77928 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:25.499416 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05cb65-cc7d-4de2-af61-0a94aea77928 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:25.500193 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05cb65-cc7d-4de2-af61-0a94aea77928 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:25.500502 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05cb65-cc7d-4de2-af61-0a94aea77928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:25.501886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05cb65-cc7d-4de2-af61-0a94aea77928 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:25.502388 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26865a9-c1e1-42bf-967c-4904bfbaabd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-f26865a9-c1e1-42bf-967c-4904bfbaabd5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:25.510777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:25.512312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:25.514631 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:25.514631 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:25.514631 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:25.514631 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:25.514631 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:25.514631 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:25.514631 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:25.514631 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:25.514631 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:25.514631 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:25.514631 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:25.514631 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:25.515805 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 39/78] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:47:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:25.515805 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05cb65-cc7d-4de2-af61-0a94aea77928 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:25.516568 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 40/79] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:25.516568 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26865a9-c1e1-42bf-967c-4904bfbaabd5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:25.627426 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26865a9-c1e1-42bf-967c-4904bfbaabd5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:25.634034 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05cb65-cc7d-4de2-af61-0a94aea77928 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:25.660645 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:25.661925 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d81b2-fefb-4f2f-a8e6-c25fdd8542a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:25.662575 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d81b2-fefb-4f2f-a8e6-c25fdd8542a2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:25.662862 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d81b2-fefb-4f2f-a8e6-c25fdd8542a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:25.663148 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d81b2-fefb-4f2f-a8e6-c25fdd8542a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:25.669229 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bb99c-def1-405b-ad22-5d612cc945ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:25.670107 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bb99c-def1-405b-ad22-5d612cc945ec None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:25.670395 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bb99c-def1-405b-ad22-5d612cc945ec None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:25.670672 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bb99c-def1-405b-ad22-5d612cc945ec None admin] PATH_INFO: `/v3/users/e96f467bcdaf40f288963da3024186a8` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:25.671903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bb99c-def1-405b-ad22-5d612cc945ec None admin] RBAC: Authorizing `identity:get_user(user_id=e96f467bcdaf40f288963da3024186a8)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:25.673376 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bb99c-def1-405b-ad22-5d612cc945ec None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:25.675014 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 40/80] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:25 2022] GET /identity/v3/users/e96f467bcdaf40f288963da3024186a8 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:25.675779 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bb99c-def1-405b-ad22-5d612cc945ec None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:25.720507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:25.741441 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d81b2-fefb-4f2f-a8e6-c25fdd8542a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:25.745333 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d81b2-fefb-4f2f-a8e6-c25fdd8542a2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:25.776566 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bb99c-def1-405b-ad22-5d612cc945ec None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:25.811184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24981f5-0431-4a23-a8c7-646bf8ad9b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:25.812005 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24981f5-0431-4a23-a8c7-646bf8ad9b13 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:25.812292 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24981f5-0431-4a23-a8c7-646bf8ad9b13 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:25.812573 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24981f5-0431-4a23-a8c7-646bf8ad9b13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:25.813750 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24981f5-0431-4a23-a8c7-646bf8ad9b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:25.815193 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24981f5-0431-4a23-a8c7-646bf8ad9b13 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:25.816838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 41/81] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:25.817700 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24981f5-0431-4a23-a8c7-646bf8ad9b13 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:25.864268 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 41/82] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:25.865133 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d81b2-fefb-4f2f-a8e6-c25fdd8542a2 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:25.880796 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:25.920620 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24981f5-0431-4a23-a8c7-646bf8ad9b13 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:25.951493 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:25.953900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbded4-7237-4c9f-b34d-fedc974ea0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:25.954783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbded4-7237-4c9f-b34d-fedc974ea0e9 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:25.955077 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbded4-7237-4c9f-b34d-fedc974ea0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:25.955362 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbded4-7237-4c9f-b34d-fedc974ea0e9 None admin] PATH_INFO: `/v3/users/9c838dd213e94d348715998fbd4b45b9` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:25.956588 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbded4-7237-4c9f-b34d-fedc974ea0e9 None admin] RBAC: Authorizing `identity:get_user(user_id=9c838dd213e94d348715998fbd4b45b9)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:25.958038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbded4-7237-4c9f-b34d-fedc974ea0e9 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:25.959853 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 42/83] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:25 2022] GET /identity/v3/users/9c838dd213e94d348715998fbd4b45b9 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:25.960465 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbded4-7237-4c9f-b34d-fedc974ea0e9 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:25.968285 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d81b2-fefb-4f2f-a8e6-c25fdd8542a2 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:26.004877 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db014a21-3df1-4432-8189-c980646c77e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:26.005879 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db014a21-3df1-4432-8189-c980646c77e9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:26.006170 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db014a21-3df1-4432-8189-c980646c77e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:26.006451 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db014a21-3df1-4432-8189-c980646c77e9 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:26.007567 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db014a21-3df1-4432-8189-c980646c77e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:26.007928 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db014a21-3df1-4432-8189-c980646c77e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:26.009426 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db014a21-3df1-4432-8189-c980646c77e9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:26.017927 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 42/84] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:26.018721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db014a21-3df1-4432-8189-c980646c77e9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:26.071543 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbded4-7237-4c9f-b34d-fedc974ea0e9 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:26.102077 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:26.108113 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5272a-52f2-45d8-beca-fab7e0d60101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:26.108773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5272a-52f2-45d8-beca-fab7e0d60101 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:26.109071 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5272a-52f2-45d8-beca-fab7e0d60101 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:26.109361 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5272a-52f2-45d8-beca-fab7e0d60101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:26.120695 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db014a21-3df1-4432-8189-c980646c77e9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:26.154774 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113697d-c5f9-4014-b375-d740a8304ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:26.155457 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113697d-c5f9-4014-b375-d740a8304ab4 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:26.155748 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113697d-c5f9-4014-b375-d740a8304ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:26.156066 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113697d-c5f9-4014-b375-d740a8304ab4 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:26.156776 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113697d-c5f9-4014-b375-d740a8304ab4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:26.158234 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113697d-c5f9-4014-b375-d740a8304ab4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:26.177843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5272a-52f2-45d8-beca-fab7e0d60101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:26.179343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5272a-52f2-45d8-beca-fab7e0d60101 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:26.184827 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 43/85] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 14 11:47:26 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:47:26.185683 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113697d-c5f9-4014-b375-d740a8304ab4 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:26.189235 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:26.313461 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 43/86] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:26.314242 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5272a-52f2-45d8-beca-fab7e0d60101 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:26.325324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113697d-c5f9-4014-b375-d740a8304ab4 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:26.350125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:26.375800 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00c6e2-c44b-4931-8883-d0f2e5347b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:26.376718 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00c6e2-c44b-4931-8883-d0f2e5347b88 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:26.377006 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00c6e2-c44b-4931-8883-d0f2e5347b88 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:26.377293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00c6e2-c44b-4931-8883-d0f2e5347b88 None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:26.378505 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00c6e2-c44b-4931-8883-d0f2e5347b88 None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:26.380025 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00c6e2-c44b-4931-8883-d0f2e5347b88 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:26.382072 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 44/87] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:26 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:26.383076 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00c6e2-c44b-4931-8883-d0f2e5347b88 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:26.434564 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5272a-52f2-45d8-beca-fab7e0d60101 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:26.469199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:26.497098 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251f9ad-9729-4d08-910d-7cb0ffd9353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:26.498588 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251f9ad-9729-4d08-910d-7cb0ffd9353d None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:26.499159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251f9ad-9729-4d08-910d-7cb0ffd9353d None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:26.499734 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251f9ad-9729-4d08-910d-7cb0ffd9353d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:26.511567 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00c6e2-c44b-4931-8883-d0f2e5347b88 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:26.559905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419c63e-85ab-4c54-99a0-9db5502b997f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:26.560809 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419c63e-85ab-4c54-99a0-9db5502b997f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:26.561099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419c63e-85ab-4c54-99a0-9db5502b997f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:26.561392 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419c63e-85ab-4c54-99a0-9db5502b997f None admin] PATH_INFO: `/v3/users/9c838dd213e94d348715998fbd4b45b9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:26.562584 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419c63e-85ab-4c54-99a0-9db5502b997f None admin] RBAC: Authorizing `identity:get_user(user_id=9c838dd213e94d348715998fbd4b45b9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:26.564195 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419c63e-85ab-4c54-99a0-9db5502b997f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:26.565844 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 45/88] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:26 2022] GET /identity/v3/users/9c838dd213e94d348715998fbd4b45b9 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:26.566707 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419c63e-85ab-4c54-99a0-9db5502b997f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:26.598193 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251f9ad-9729-4d08-910d-7cb0ffd9353d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:26.599690 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251f9ad-9729-4d08-910d-7cb0ffd9353d None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:26.634609 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:26.690098 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419c63e-85ab-4c54-99a0-9db5502b997f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:26.708944 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 44/89] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:26.709967 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251f9ad-9729-4d08-910d-7cb0ffd9353d None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:26.728370 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c0a68-2598-4bb3-b0d1-1c8e99645143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:26.729305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c0a68-2598-4bb3-b0d1-1c8e99645143 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:26.729589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c0a68-2598-4bb3-b0d1-1c8e99645143 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:26.729914 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c0a68-2598-4bb3-b0d1-1c8e99645143 None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:26.731143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c0a68-2598-4bb3-b0d1-1c8e99645143 None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:26.732873 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c0a68-2598-4bb3-b0d1-1c8e99645143 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:26.734667 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 46/90] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:26 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:26.736867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c0a68-2598-4bb3-b0d1-1c8e99645143 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:26.746491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:26.825125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251f9ad-9729-4d08-910d-7cb0ffd9353d None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:26.849142 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c0a68-2598-4bb3-b0d1-1c8e99645143 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:26.860162 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:26.865382 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf138074-3c69-45f7-89df-bfb878e08041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:26.866220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf138074-3c69-45f7-89df-bfb878e08041 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:26.866517 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf138074-3c69-45f7-89df-bfb878e08041 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:26.866833 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf138074-3c69-45f7-89df-bfb878e08041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:26.869092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf138074-3c69-45f7-89df-bfb878e08041 None admin] RBAC: Adding query filter params (role.id=7b517960be1c437d850537c7e0aa985a, scope.project.id=d9040b944c534111b0b4718481683172, user.id=9c838dd213e94d348715998fbd4b45b9) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:26.869423 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf138074-3c69-45f7-89df-bfb878e08041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:26.870905 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf138074-3c69-45f7-89df-bfb878e08041 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:26.887977 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 45/91] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:26 2022] GET /identity/v3/role_assignments?user.id=9c838dd213e94d348715998fbd4b45b9&scope.project.id=d9040b944c534111b0b4718481683172&role.id=7b517960be1c437d850537c7e0aa985a => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:26.887977 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf138074-3c69-45f7-89df-bfb878e08041 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:26.922817 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae07a3c-effc-4773-b471-d2f792fa2325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:26.923658 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae07a3c-effc-4773-b471-d2f792fa2325 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:26.923976 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae07a3c-effc-4773-b471-d2f792fa2325 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:26.924262 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae07a3c-effc-4773-b471-d2f792fa2325 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:27.003924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf138074-3c69-45f7-89df-bfb878e08041 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:27.044231 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b55b00-2c09-464a-a13e-d66b578e8037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:27.045114 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b55b00-2c09-464a-a13e-d66b578e8037 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:27.045405 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b55b00-2c09-464a-a13e-d66b578e8037 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:27.045688 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b55b00-2c09-464a-a13e-d66b578e8037 None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:27.047080 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b55b00-2c09-464a-a13e-d66b578e8037 None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:27.048472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b55b00-2c09-464a-a13e-d66b578e8037 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:27.050226 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 46/92] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:26 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:27.051041 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b55b00-2c09-464a-a13e-d66b578e8037 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:27.121692 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:27.132915 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae07a3c-effc-4773-b471-d2f792fa2325 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:27.136024 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae07a3c-effc-4773-b471-d2f792fa2325 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:27.150367 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:27.217922 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b55b00-2c09-464a-a13e-d66b578e8037 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:27.284367 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 47/93] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:27.285564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae07a3c-effc-4773-b471-d2f792fa2325 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:27.344767 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee71f9-94d8-4ecb-a9d1-eb2bdd08ddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:27.345312 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee71f9-94d8-4ecb-a9d1-eb2bdd08ddb7 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:27.345610 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee71f9-94d8-4ecb-a9d1-eb2bdd08ddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:27.345902 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee71f9-94d8-4ecb-a9d1-eb2bdd08ddb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:27.346752 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee71f9-94d8-4ecb-a9d1-eb2bdd08ddb7 None admin] RBAC: Adding query filter params (role.id=321ee52ce1bc4eafa201f23f55f23d2b, scope.project.id=d9040b944c534111b0b4718481683172, user.id=e96f467bcdaf40f288963da3024186a8) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:27.347086 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee71f9-94d8-4ecb-a9d1-eb2bdd08ddb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:27.348577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee71f9-94d8-4ecb-a9d1-eb2bdd08ddb7 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:27.366224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 47/94] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:27 2022] GET /identity/v3/role_assignments?user.id=e96f467bcdaf40f288963da3024186a8&scope.project.id=d9040b944c534111b0b4718481683172&role.id=321ee52ce1bc4eafa201f23f55f23d2b => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:27.366497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee71f9-94d8-4ecb-a9d1-eb2bdd08ddb7 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:27.404611 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae07a3c-effc-4773-b471-d2f792fa2325 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:27.415711 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:27.449960 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fc45d-c2b2-4370-b19e-0dad4d7da3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:27.451311 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fc45d-c2b2-4370-b19e-0dad4d7da3e2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:27.452269 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fc45d-c2b2-4370-b19e-0dad4d7da3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:27.452755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fc45d-c2b2-4370-b19e-0dad4d7da3e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:27.454144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fc45d-c2b2-4370-b19e-0dad4d7da3e2 None admin] RBAC: Adding query filter params (role.id=703199a2f03143128fbac7cc8481b912, scope.project.id=d9040b944c534111b0b4718481683172, user.id=9c838dd213e94d348715998fbd4b45b9) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:27.454800 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fc45d-c2b2-4370-b19e-0dad4d7da3e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:27.456838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fc45d-c2b2-4370-b19e-0dad4d7da3e2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:27.464440 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 48/95] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:27 2022] GET /identity/v3/role_assignments?user.id=9c838dd213e94d348715998fbd4b45b9&scope.project.id=d9040b944c534111b0b4718481683172&role.id=703199a2f03143128fbac7cc8481b912 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:27.555498 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee71f9-94d8-4ecb-a9d1-eb2bdd08ddb7 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:27.589837 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:27.599499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff82933-98f0-4889-94d7-1121888b8452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:27.600800 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff82933-98f0-4889-94d7-1121888b8452 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:27.601331 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff82933-98f0-4889-94d7-1121888b8452 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:27.601977 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff82933-98f0-4889-94d7-1121888b8452 None admin] PATH_INFO: `/v3/projects/ea34c06a1c95494ab3e568dcaf9f9ee2` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:27.603817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff82933-98f0-4889-94d7-1121888b8452 None admin] RBAC: Authorizing `identity:get_project(project_id=ea34c06a1c95494ab3e568dcaf9f9ee2)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:27.605879 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff82933-98f0-4889-94d7-1121888b8452 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:27.607946 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 48/96] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:27 2022] GET /identity/v3/projects/ea34c06a1c95494ab3e568dcaf9f9ee2 => generated 312 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:27.617449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fc45d-c2b2-4370-b19e-0dad4d7da3e2 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:27.761888 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fc45d-c2b2-4370-b19e-0dad4d7da3e2 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:27.807835 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601268d-8740-42b9-b484-9b91e9522064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:27.808976 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601268d-8740-42b9-b484-9b91e9522064 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:27.809470 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601268d-8740-42b9-b484-9b91e9522064 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:27.809988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601268d-8740-42b9-b484-9b91e9522064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:27.811045 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601268d-8740-42b9-b484-9b91e9522064 None admin] RBAC: Adding query filter params (role.id=7b517960be1c437d850537c7e0aa985a, scope.project.id=ea34c06a1c95494ab3e568dcaf9f9ee2, user.id=9c838dd213e94d348715998fbd4b45b9) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:27.811365 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601268d-8740-42b9-b484-9b91e9522064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:27.813052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601268d-8740-42b9-b484-9b91e9522064 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:27.819434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 49/97] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:27 2022] GET /identity/v3/role_assignments?user.id=9c838dd213e94d348715998fbd4b45b9&scope.project.id=ea34c06a1c95494ab3e568dcaf9f9ee2&role.id=7b517960be1c437d850537c7e0aa985a => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:29.028552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911dad8-01cf-4d5e-9e42-987fde4305e2 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:29.029126 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911dad8-01cf-4d5e-9e42-987fde4305e2 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:29.029126 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911dad8-01cf-4d5e-9e42-987fde4305e2 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:29.030595 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 49/98] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:29.045715 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2d4b6-ba93-4ff2-9ea2-0f457c86daae None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:29.046236 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2d4b6-ba93-4ff2-9ea2-0f457c86daae None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:29.046316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2d4b6-ba93-4ff2-9ea2-0f457c86daae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:29.073030 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-46c2d4b6-ba93-4ff2-9ea2-0f457c86daae None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:29.074259 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-46c2d4b6-ba93-4ff2-9ea2-0f457c86daae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:29.112594 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:29.176609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 50/99] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:29.219126 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911dad8-01cf-4d5e-9e42-987fde4305e2 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:29.284884 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727fe34-a076-46c5-97ab-e97b9824b49c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:29.285178 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727fe34-a076-46c5-97ab-e97b9824b49c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:29.285370 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727fe34-a076-46c5-97ab-e97b9824b49c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:29.286739 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 51/100] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:47:29.291828 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff4110-fc5f-453d-839b-905bb9ef0472 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:29.292143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff4110-fc5f-453d-839b-905bb9ef0472 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:29.292427 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff4110-fc5f-453d-839b-905bb9ef0472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:29.316836 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-d0ff4110-fc5f-453d-839b-905bb9ef0472 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:29.318043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d0ff4110-fc5f-453d-839b-905bb9ef0472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:29.428579 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911dad8-01cf-4d5e-9e42-987fde4305e2 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:29.479819 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 52/101] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:29.516416 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4580fa-fd81-4d26-adf2-693d8426fe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:29.517055 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff4110-fc5f-453d-839b-905bb9ef0472 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:29.517243 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4580fa-fd81-4d26-adf2-693d8426fe1b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:29.517537 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4580fa-fd81-4d26-adf2-693d8426fe1b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:29.517818 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4580fa-fd81-4d26-adf2-693d8426fe1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:29.537074 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4580fa-fd81-4d26-adf2-693d8426fe1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-5d4580fa-fd81-4d26-adf2-693d8426fe1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:29.545617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:29.546553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:29.547343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:29.547343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:29.547343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:29.547343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:29.547343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:29.547343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:29.547343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:29.547343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:29.547343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:29.547343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:29.547343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:29.547343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:47:29.551922 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 50/102] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:29.553130 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4580fa-fd81-4d26-adf2-693d8426fe1b None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:29.715380 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:29.727065 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:29.738117 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff4110-fc5f-453d-839b-905bb9ef0472 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:29.751582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4580fa-fd81-4d26-adf2-693d8426fe1b None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:29.813529 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc282c6c-760e-456f-a696-506d3ea199f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:29.814294 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc282c6c-760e-456f-a696-506d3ea199f7 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:29.814690 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc282c6c-760e-456f-a696-506d3ea199f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:29.815098 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc282c6c-760e-456f-a696-506d3ea199f7 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:29.815997 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc282c6c-760e-456f-a696-506d3ea199f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:29.816417 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc282c6c-760e-456f-a696-506d3ea199f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:29.817933 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc282c6c-760e-456f-a696-506d3ea199f7 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:29.818733 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385d2ac-6a6c-49f9-a621-e6a93602269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:29.819792 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385d2ac-6a6c-49f9-a621-e6a93602269c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:29.820301 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385d2ac-6a6c-49f9-a621-e6a93602269c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:29.820788 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385d2ac-6a6c-49f9-a621-e6a93602269c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:29.824652 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385d2ac-6a6c-49f9-a621-e6a93602269c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:29.826531 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385d2ac-6a6c-49f9-a621-e6a93602269c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:29.829017 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 53/103] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:29.834231 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385d2ac-6a6c-49f9-a621-e6a93602269c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:29.836687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 51/104] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:29.852992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc282c6c-760e-456f-a696-506d3ea199f7 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:29.970776 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385d2ac-6a6c-49f9-a621-e6a93602269c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:30.013589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa5e4f-509c-4403-817e-9c15600708e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:30.014617 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa5e4f-509c-4403-817e-9c15600708e9 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:30.015134 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa5e4f-509c-4403-817e-9c15600708e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:30.015614 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa5e4f-509c-4403-817e-9c15600708e9 None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:30.016567 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa5e4f-509c-4403-817e-9c15600708e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:30.019217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa5e4f-509c-4403-817e-9c15600708e9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:30.054968 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc282c6c-760e-456f-a696-506d3ea199f7 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:30.083915 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 54/105] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 14 11:47:29 2022] POST /identity/v3/projects => generated 302 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:47:30.085578 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420d3b5-a1b9-47cd-a2e4-f15a50fd4658 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:30.085884 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420d3b5-a1b9-47cd-a2e4-f15a50fd4658 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:30.086182 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420d3b5-a1b9-47cd-a2e4-f15a50fd4658 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:30.087404 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 55/106] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:30.088220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:30.101134 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37cece-a4b3-49ac-a7f3-413b88233aef None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:30.101956 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37cece-a4b3-49ac-a7f3-413b88233aef None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:30.101956 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37cece-a4b3-49ac-a7f3-413b88233aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:30.103609 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde8a27-20af-42ee-8662-b3f57112c84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:30.104602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde8a27-20af-42ee-8662-b3f57112c84d None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:30.104902 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde8a27-20af-42ee-8662-b3f57112c84d None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:30.105190 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde8a27-20af-42ee-8662-b3f57112c84d None admin] PATH_INFO: `/v3/users/ada5391afd8e4791ba751c6c05eaba9d` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:30.153501 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-dc37cece-a4b3-49ac-a7f3-413b88233aef None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:30.155064 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-dc37cece-a4b3-49ac-a7f3-413b88233aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:30.164747 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde8a27-20af-42ee-8662-b3f57112c84d None admin] RBAC: Authorizing `identity:get_user(user_id=ada5391afd8e4791ba751c6c05eaba9d)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:30.166289 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde8a27-20af-42ee-8662-b3f57112c84d None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:30.168155 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 52/107] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:29 2022] GET /identity/v3/users/ada5391afd8e4791ba751c6c05eaba9d => generated 289 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:30.171365 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:30.188034 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde8a27-20af-42ee-8662-b3f57112c84d None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:30.278685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 56/108] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:30.317896 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37cece-a4b3-49ac-a7f3-413b88233aef None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:30.352755 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde8a27-20af-42ee-8662-b3f57112c84d None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:30.391279 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61040b-87fd-4417-a5af-91767a307366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:30.392049 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61040b-87fd-4417-a5af-91767a307366 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:30.392349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61040b-87fd-4417-a5af-91767a307366 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:30.392638 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61040b-87fd-4417-a5af-91767a307366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:30.454140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:30.468844 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61040b-87fd-4417-a5af-91767a307366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:30.470689 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61040b-87fd-4417-a5af-91767a307366 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:30.507655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37cece-a4b3-49ac-a7f3-413b88233aef None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:30.581563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584961d-37c2-41dc-8a19-62fa9dd5080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:30.582372 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584961d-37c2-41dc-8a19-62fa9dd5080a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:30.582664 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584961d-37c2-41dc-8a19-62fa9dd5080a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:30.582955 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584961d-37c2-41dc-8a19-62fa9dd5080a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:30.603247 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584961d-37c2-41dc-8a19-62fa9dd5080a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-3584961d-37c2-41dc-8a19-62fa9dd5080a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:30.614787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:30.615635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:30.617082 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:30.617082 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:30.617082 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:30.617082 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:30.617082 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:30.617082 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:30.617082 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:30.617082 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:30.617082 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:30.617082 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:30.617082 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:30.617082 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:30.617082 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 57/109] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:30.625840 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584961d-37c2-41dc-8a19-62fa9dd5080a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:30.640882 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:30.680069 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 53/110] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:30.686862 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61040b-87fd-4417-a5af-91767a307366 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:30.776367 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584961d-37c2-41dc-8a19-62fa9dd5080a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:30.825290 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43b2c3-b7a6-4a46-a8ac-889fd8477b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:30.826043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43b2c3-b7a6-4a46-a8ac-889fd8477b22 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:30.826340 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43b2c3-b7a6-4a46-a8ac-889fd8477b22 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:30.828691 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43b2c3-b7a6-4a46-a8ac-889fd8477b22 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:30.829601 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43b2c3-b7a6-4a46-a8ac-889fd8477b22 None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:30.829926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43b2c3-b7a6-4a46-a8ac-889fd8477b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:30.833208 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43b2c3-b7a6-4a46-a8ac-889fd8477b22 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:30.846906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 58/111] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:30.853595 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:30.869756 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43b2c3-b7a6-4a46-a8ac-889fd8477b22 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:30.911241 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61040b-87fd-4417-a5af-91767a307366 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:30.990072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d6171-4090-4211-85bf-2bc3072012db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:30.992469 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d6171-4090-4211-85bf-2bc3072012db None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:30.996099 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d6171-4090-4211-85bf-2bc3072012db None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:30.996696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d6171-4090-4211-85bf-2bc3072012db None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:31.003303 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d6171-4090-4211-85bf-2bc3072012db None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:31.005971 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d6171-4090-4211-85bf-2bc3072012db None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:31.010405 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 54/112] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:30 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:31.017658 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d6171-4090-4211-85bf-2bc3072012db None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:31.021026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:31.083260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43b2c3-b7a6-4a46-a8ac-889fd8477b22 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:31.126440 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b52507-909d-4645-a2a3-0a19ec7f2792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:31.128476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52507-909d-4645-a2a3-0a19ec7f2792 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:31.128997 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52507-909d-4645-a2a3-0a19ec7f2792 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:31.129491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52507-909d-4645-a2a3-0a19ec7f2792 None admin] PATH_INFO: `/v3/users/9c838dd213e94d348715998fbd4b45b9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:31.131101 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b52507-909d-4645-a2a3-0a19ec7f2792 None admin] RBAC: Authorizing `identity:get_user(user_id=9c838dd213e94d348715998fbd4b45b9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:31.133612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b52507-909d-4645-a2a3-0a19ec7f2792 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:31.135772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 59/113] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:30 2022] GET /identity/v3/users/9c838dd213e94d348715998fbd4b45b9 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:31.137667 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cb029-2287-4e40-a156-4772c61c7ec5 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:31.138247 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cb029-2287-4e40-a156-4772c61c7ec5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:31.138900 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cb029-2287-4e40-a156-4772c61c7ec5 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:31.140345 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 60/114] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:31.141552 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be289b15-eb09-4e2b-bc1e-50ed03fac2f8 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:31.141921 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be289b15-eb09-4e2b-bc1e-50ed03fac2f8 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:31.142282 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be289b15-eb09-4e2b-bc1e-50ed03fac2f8 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:31.143821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 61/115] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:31.150044 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b850b4-05ee-42d4-bdee-0a40d28a624a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:31.150431 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b850b4-05ee-42d4-bdee-0a40d28a624a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:31.150827 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b850b4-05ee-42d4-bdee-0a40d28a624a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:31.171673 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-81b850b4-05ee-42d4-bdee-0a40d28a624a None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:31.178150 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-81b850b4-05ee-42d4-bdee-0a40d28a624a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:31.192811 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d6171-4090-4211-85bf-2bc3072012db None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:31.239451 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b163de-2813-4977-b6ca-66659afc8d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:31.240198 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b163de-2813-4977-b6ca-66659afc8d7e None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:31.240493 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b163de-2813-4977-b6ca-66659afc8d7e None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:31.240809 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b163de-2813-4977-b6ca-66659afc8d7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:31.242913 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b163de-2813-4977-b6ca-66659afc8d7e None admin] RBAC: Adding query filter params (role.id=478bbce5a7b34a23aabf38a0d1789a54, scope.project.id=d9040b944c534111b0b4718481683172, user.id=ada5391afd8e4791ba751c6c05eaba9d) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:31.243245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b163de-2813-4977-b6ca-66659afc8d7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:31.244803 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b163de-2813-4977-b6ca-66659afc8d7e None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:31.251202 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 55/116] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:31 2022] GET /identity/v3/role_assignments?user.id=ada5391afd8e4791ba751c6c05eaba9d&scope.project.id=d9040b944c534111b0b4718481683172&role.id=478bbce5a7b34a23aabf38a0d1789a54 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:31.252137 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b163de-2813-4977-b6ca-66659afc8d7e None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:31.265695 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:31.286700 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 62/117] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:31.289332 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f225343-0472-4d2e-8be7-b2a063cef1f2 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:31.289786 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f225343-0472-4d2e-8be7-b2a063cef1f2 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:31.290227 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f225343-0472-4d2e-8be7-b2a063cef1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:31.310447 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-1f225343-0472-4d2e-8be7-b2a063cef1f2 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:31.313189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1f225343-0472-4d2e-8be7-b2a063cef1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:31.394951 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:31.408450 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 63/118] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:31.409555 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f225343-0472-4d2e-8be7-b2a063cef1f2 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:31.451416 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b163de-2813-4977-b6ca-66659afc8d7e None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:31.495250 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae8750-e659-4fa8-bd28-b4c183ab26a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:31.496262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae8750-e659-4fa8-bd28-b4c183ab26a6 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:31.496654 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae8750-e659-4fa8-bd28-b4c183ab26a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:31.497044 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae8750-e659-4fa8-bd28-b4c183ab26a6 None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:31.499620 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae8750-e659-4fa8-bd28-b4c183ab26a6 None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:31.501374 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae8750-e659-4fa8-bd28-b4c183ab26a6 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:31.503707 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 56/119] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:31 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:31.505082 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a1495-e26b-40c8-8285-91a9d6e7b724 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:31.507802 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a1495-e26b-40c8-8285-91a9d6e7b724 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:31.507802 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a1495-e26b-40c8-8285-91a9d6e7b724 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:31.508796 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 57/120] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:31.509782 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a1495-e26b-40c8-8285-91a9d6e7b724 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:31.548479 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f225343-0472-4d2e-8be7-b2a063cef1f2 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:31.587779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b9998-6de1-47b4-9428-efb122890daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:31.588729 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b9998-6de1-47b4-9428-efb122890daf None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:31.589025 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b9998-6de1-47b4-9428-efb122890daf None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:31.589405 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b9998-6de1-47b4-9428-efb122890daf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:31.601894 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b9998-6de1-47b4-9428-efb122890daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:31.609756 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-de0b9998-6de1-47b4-9428-efb122890daf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:31.611438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:31.613325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:31.614135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:31.614135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:31.614135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:31.614135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:31.614135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:31.614135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:31.614135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:31.614135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:31.614135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:31.614135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:31.614135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:31.614135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:31.616707 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 64/121] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:47:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:31.617748 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b9998-6de1-47b4-9428-efb122890daf None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:31.644846 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a1495-e26b-40c8-8285-91a9d6e7b724 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:31.682692 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:31.702801 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2173088-547f-479c-9a18-d0574a29951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:31.703664 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2173088-547f-479c-9a18-d0574a29951c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:31.704039 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2173088-547f-479c-9a18-d0574a29951c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:31.704331 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2173088-547f-479c-9a18-d0574a29951c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:31.719588 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2173088-547f-479c-9a18-d0574a29951c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-e2173088-547f-479c-9a18-d0574a29951c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:31.732132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:31.732973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:31.733687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:31.733687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:31.733687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:31.733687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:31.733687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:31.733687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:31.733687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:31.733687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:31.733687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:31.733687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:31.733687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:47:31.733687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:47:31.733687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 58/122] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:47:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:31.740007 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91994328-2a8a-4c4c-b472-ac16e7c5a8ba None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:31.740007 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91994328-2a8a-4c4c-b472-ac16e7c5a8ba None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:31.740007 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91994328-2a8a-4c4c-b472-ac16e7c5a8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:31.743759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b9998-6de1-47b4-9428-efb122890daf None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:31.759128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-91994328-2a8a-4c4c-b472-ac16e7c5a8ba None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:31.760973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-91994328-2a8a-4c4c-b472-ac16e7c5a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:31.785571 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfae647-a0f1-4297-a7df-77553d3aeba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:31.786766 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfae647-a0f1-4297-a7df-77553d3aeba0 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:31.787298 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfae647-a0f1-4297-a7df-77553d3aeba0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:31.788552 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfae647-a0f1-4297-a7df-77553d3aeba0 None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172/users/9c838dd213e94d348715998fbd4b45b9/roles/7b517960be1c437d850537c7e0aa985a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:31.790825 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfae647-a0f1-4297-a7df-77553d3aeba0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9040b944c534111b0b4718481683172, user_id=9c838dd213e94d348715998fbd4b45b9, role_id=7b517960be1c437d850537c7e0aa985a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:31.792565 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfae647-a0f1-4297-a7df-77553d3aeba0 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:31.809712 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 65/123] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:47:31 2022] PUT /identity/v3/projects/d9040b944c534111b0b4718481683172/users/9c838dd213e94d348715998fbd4b45b9/roles/7b517960be1c437d850537c7e0aa985a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:47:31.810959 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfae647-a0f1-4297-a7df-77553d3aeba0 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:31.859991 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 59/124] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:31.861003 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91994328-2a8a-4c4c-b472-ac16e7c5a8ba None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:32.005427 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:32.026270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfae647-a0f1-4297-a7df-77553d3aeba0 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:32.060564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:32.066329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91994328-2a8a-4c4c-b472-ac16e7c5a8ba None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:32.095757 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2568e0-5eb8-4ace-b306-9abc9a16d525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:32.096574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2568e0-5eb8-4ace-b306-9abc9a16d525 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:32.096889 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2568e0-5eb8-4ace-b306-9abc9a16d525 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:32.097124 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2568e0-5eb8-4ace-b306-9abc9a16d525 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:32.097942 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2568e0-5eb8-4ace-b306-9abc9a16d525 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:32.098262 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2568e0-5eb8-4ace-b306-9abc9a16d525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:32.099686 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2568e0-5eb8-4ace-b306-9abc9a16d525 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:32.109387 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 66/125] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:32.110399 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2568e0-5eb8-4ace-b306-9abc9a16d525 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:32.126861 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dee36-7dd5-4440-8c07-625391f8197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:32.127448 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dee36-7dd5-4440-8c07-625391f8197f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:32.128054 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dee36-7dd5-4440-8c07-625391f8197f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:32.128339 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dee36-7dd5-4440-8c07-625391f8197f None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:32.129214 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dee36-7dd5-4440-8c07-625391f8197f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:32.129644 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dee36-7dd5-4440-8c07-625391f8197f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:32.131094 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dee36-7dd5-4440-8c07-625391f8197f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:32.141693 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 60/126] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:47:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:32.142677 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dee36-7dd5-4440-8c07-625391f8197f None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:32.244965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2568e0-5eb8-4ace-b306-9abc9a16d525 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:32.293489 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a15c20-9e2d-4ddc-83d1-27b7ebf5018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:32.295010 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a15c20-9e2d-4ddc-83d1-27b7ebf5018d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:32.295304 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a15c20-9e2d-4ddc-83d1-27b7ebf5018d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:32.295587 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a15c20-9e2d-4ddc-83d1-27b7ebf5018d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:32.299912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dee36-7dd5-4440-8c07-625391f8197f None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:32.321662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a15c20-9e2d-4ddc-83d1-27b7ebf5018d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-01a15c20-9e2d-4ddc-83d1-27b7ebf5018d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:32.329462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:32.330305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:32.331074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:32.331074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:32.331074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:32.331074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:32.331074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:32.331074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:32.331074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:32.331074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:32.331074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:32.331074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:32.331074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:32.331074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:32.333434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 67/127] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:32.341390 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a15c20-9e2d-4ddc-83d1-27b7ebf5018d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:32.358595 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:32.371682 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61517192-e8c9-41aa-9fc2-37728172bc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:32.372601 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61517192-e8c9-41aa-9fc2-37728172bc11 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:32.372896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61517192-e8c9-41aa-9fc2-37728172bc11 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:32.373183 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61517192-e8c9-41aa-9fc2-37728172bc11 None admin] PATH_INFO: `/v3/users/e96f467bcdaf40f288963da3024186a8` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:32.375990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61517192-e8c9-41aa-9fc2-37728172bc11 None admin] RBAC: Authorizing `identity:get_user(user_id=e96f467bcdaf40f288963da3024186a8)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:32.377547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61517192-e8c9-41aa-9fc2-37728172bc11 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:32.379351 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 61/128] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:32 2022] GET /identity/v3/users/e96f467bcdaf40f288963da3024186a8 => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:32.383873 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61517192-e8c9-41aa-9fc2-37728172bc11 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:32.420549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:32.542969 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a15c20-9e2d-4ddc-83d1-27b7ebf5018d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:32.565706 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61517192-e8c9-41aa-9fc2-37728172bc11 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:32.610654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a769-2758-419a-8956-17c21011073d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:32.611539 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a769-2758-419a-8956-17c21011073d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:32.611825 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a769-2758-419a-8956-17c21011073d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:32.612130 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a769-2758-419a-8956-17c21011073d None admin] PATH_INFO: `/v3/users/9c838dd213e94d348715998fbd4b45b9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:32.613458 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a769-2758-419a-8956-17c21011073d None admin] RBAC: Authorizing `identity:get_user(user_id=9c838dd213e94d348715998fbd4b45b9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:32.614928 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a769-2758-419a-8956-17c21011073d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:32.616683 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 68/129] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:32 2022] GET /identity/v3/users/9c838dd213e94d348715998fbd4b45b9 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:32.617484 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a769-2758-419a-8956-17c21011073d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:32.631161 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754dcfb1-2bfd-4ee7-8fee-bb86e2541d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:32.632314 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dcfb1-2bfd-4ee7-8fee-bb86e2541d7b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:32.632813 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dcfb1-2bfd-4ee7-8fee-bb86e2541d7b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:32.633265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dcfb1-2bfd-4ee7-8fee-bb86e2541d7b None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:32.634037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754dcfb1-2bfd-4ee7-8fee-bb86e2541d7b None admin] RBAC: Adding query filter params (name=member) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:32.634356 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754dcfb1-2bfd-4ee7-8fee-bb86e2541d7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:32.635758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754dcfb1-2bfd-4ee7-8fee-bb86e2541d7b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:32.646334 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 62/130] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:32.648211 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754dcfb1-2bfd-4ee7-8fee-bb86e2541d7b None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:32.742832 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:32.773687 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a769-2758-419a-8956-17c21011073d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:32.790313 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:32.821338 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754dcfb1-2bfd-4ee7-8fee-bb86e2541d7b None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:32.848051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99515ac0-4eb0-4340-a3c4-47697fa54206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:32.849000 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99515ac0-4eb0-4340-a3c4-47697fa54206 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:32.849295 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99515ac0-4eb0-4340-a3c4-47697fa54206 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:32.849583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99515ac0-4eb0-4340-a3c4-47697fa54206 None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:32.853622 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99515ac0-4eb0-4340-a3c4-47697fa54206 None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:32.856727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99515ac0-4eb0-4340-a3c4-47697fa54206 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:32.858800 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 69/131] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:32 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:32.859795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99515ac0-4eb0-4340-a3c4-47697fa54206 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:32.924020 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23368b2-bd59-4b65-8d3d-985359d7e686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:32.924898 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23368b2-bd59-4b65-8d3d-985359d7e686 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:32.925187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23368b2-bd59-4b65-8d3d-985359d7e686 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:32.925469 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23368b2-bd59-4b65-8d3d-985359d7e686 None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:32.928686 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23368b2-bd59-4b65-8d3d-985359d7e686 None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:32.930137 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23368b2-bd59-4b65-8d3d-985359d7e686 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:32.935594 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 63/132] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:32 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:32.935594 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23368b2-bd59-4b65-8d3d-985359d7e686 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:33.016646 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99515ac0-4eb0-4340-a3c4-47697fa54206 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:33.084547 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912eab64-eaab-4982-b71d-37a71250f6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:33.085356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eab64-eaab-4982-b71d-37a71250f6fe None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:33.085646 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eab64-eaab-4982-b71d-37a71250f6fe None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:33.087108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eab64-eaab-4982-b71d-37a71250f6fe None admin] PATH_INFO: `/v3/users/9c838dd213e94d348715998fbd4b45b9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:33.089829 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912eab64-eaab-4982-b71d-37a71250f6fe None admin] RBAC: Authorizing `identity:get_user(user_id=9c838dd213e94d348715998fbd4b45b9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:33.091308 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912eab64-eaab-4982-b71d-37a71250f6fe None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:33.095398 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 70/133] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:32 2022] GET /identity/v3/users/9c838dd213e94d348715998fbd4b45b9 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:33.099277 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912eab64-eaab-4982-b71d-37a71250f6fe None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:33.111144 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23368b2-bd59-4b65-8d3d-985359d7e686 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:33.154609 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a277e-ec9a-4ce8-bdc7-d338ba43ec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:33.155521 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a277e-ec9a-4ce8-bdc7-d338ba43ec5a None admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:33.155819 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a277e-ec9a-4ce8-bdc7-d338ba43ec5a None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:33.156247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a277e-ec9a-4ce8-bdc7-d338ba43ec5a None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172/users/e96f467bcdaf40f288963da3024186a8/roles/321ee52ce1bc4eafa201f23f55f23d2b` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:33.158753 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a277e-ec9a-4ce8-bdc7-d338ba43ec5a None admin] RBAC: Authorizing `identity:create_grant(project_id=d9040b944c534111b0b4718481683172, user_id=e96f467bcdaf40f288963da3024186a8, role_id=321ee52ce1bc4eafa201f23f55f23d2b)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:33.160826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a277e-ec9a-4ce8-bdc7-d338ba43ec5a None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:33.164979 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:33.192351 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 64/134] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:47:32 2022] PUT /identity/v3/projects/d9040b944c534111b0b4718481683172/users/e96f467bcdaf40f288963da3024186a8/roles/321ee52ce1bc4eafa201f23f55f23d2b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:47:33.193642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a277e-ec9a-4ce8-bdc7-d338ba43ec5a None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:33.228039 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:33.394307 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a277e-ec9a-4ce8-bdc7-d338ba43ec5a None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:33.439737 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a9860-69d4-477a-8d34-3108c108c18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:33.441034 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a9860-69d4-477a-8d34-3108c108c18b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:33.441500 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a9860-69d4-477a-8d34-3108c108c18b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:33.441935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a9860-69d4-477a-8d34-3108c108c18b None admin] PATH_INFO: `/v3/projects/ea34c06a1c95494ab3e568dcaf9f9ee2` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:33.443329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a9860-69d4-477a-8d34-3108c108c18b None admin] RBAC: Authorizing `identity:get_project(project_id=ea34c06a1c95494ab3e568dcaf9f9ee2)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:33.445714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a9860-69d4-477a-8d34-3108c108c18b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:33.447939 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 65/135] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:33 2022] GET /identity/v3/projects/ea34c06a1c95494ab3e568dcaf9f9ee2 => generated 312 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:33.457131 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a9860-69d4-477a-8d34-3108c108c18b None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:33.538088 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:33.546769 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912eab64-eaab-4982-b71d-37a71250f6fe None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:33.606828 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5506113-9e44-4181-959e-e76c5343e395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:33.607741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5506113-9e44-4181-959e-e76c5343e395 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:33.607951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a9860-69d4-477a-8d34-3108c108c18b None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:33.608071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5506113-9e44-4181-959e-e76c5343e395 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:33.608335 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5506113-9e44-4181-959e-e76c5343e395 None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172/users/9c838dd213e94d348715998fbd4b45b9/roles/703199a2f03143128fbac7cc8481b912` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:33.610731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5506113-9e44-4181-959e-e76c5343e395 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9040b944c534111b0b4718481683172, user_id=9c838dd213e94d348715998fbd4b45b9, role_id=703199a2f03143128fbac7cc8481b912)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:33.612271 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5506113-9e44-4181-959e-e76c5343e395 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:33.639332 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 71/136] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:47:33 2022] PUT /identity/v3/projects/d9040b944c534111b0b4718481683172/users/9c838dd213e94d348715998fbd4b45b9/roles/703199a2f03143128fbac7cc8481b912 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:47:33.641363 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4692b8-390b-48d6-a00f-2cb007f53d6c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:33.641700 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4692b8-390b-48d6-a00f-2cb007f53d6c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:33.641960 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4692b8-390b-48d6-a00f-2cb007f53d6c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:33.643617 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 72/137] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:33.650939 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed5de4-88c4-4eed-9c4b-760d04da5fb2 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:33.651220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed5de4-88c4-4eed-9c4b-760d04da5fb2 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:33.651459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed5de4-88c4-4eed-9c4b-760d04da5fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:33.674624 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a0ed5de4-88c4-4eed-9c4b-760d04da5fb2 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:33.675556 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee241a-dc79-4524-bc49-18726376f4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:33.675935 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a0ed5de4-88c4-4eed-9c4b-760d04da5fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:33.676503 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee241a-dc79-4524-bc49-18726376f4b7 None admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:33.676795 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee241a-dc79-4524-bc49-18726376f4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:33.677129 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee241a-dc79-4524-bc49-18726376f4b7 None admin] PATH_INFO: `/v3/projects/ea34c06a1c95494ab3e568dcaf9f9ee2/users/9c838dd213e94d348715998fbd4b45b9/roles/7b517960be1c437d850537c7e0aa985a` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:33.684582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee241a-dc79-4524-bc49-18726376f4b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea34c06a1c95494ab3e568dcaf9f9ee2, user_id=9c838dd213e94d348715998fbd4b45b9, role_id=7b517960be1c437d850537c7e0aa985a)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:33.686133 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee241a-dc79-4524-bc49-18726376f4b7 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:33.718794 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 66/138] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:47:33 2022] PUT /identity/v3/projects/ea34c06a1c95494ab3e568dcaf9f9ee2/users/9c838dd213e94d348715998fbd4b45b9/roles/7b517960be1c437d850537c7e0aa985a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:47:33.770747 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 73/139] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 14 11:47:33.800159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee241a-dc79-4524-bc49-18726376f4b7 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:33.961661 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee241a-dc79-4524-bc49-18726376f4b7 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:33.977658 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:34.002256 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7d921-36d6-4c3e-97f8-98aef914f1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:34.003315 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7d921-36d6-4c3e-97f8-98aef914f1e8 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:34.003613 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7d921-36d6-4c3e-97f8-98aef914f1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:34.003915 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7d921-36d6-4c3e-97f8-98aef914f1e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:34.005342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7d921-36d6-4c3e-97f8-98aef914f1e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:34.007716 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7d921-36d6-4c3e-97f8-98aef914f1e8 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:34.009903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 67/140] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:34.016031 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed5de4-88c4-4eed-9c4b-760d04da5fb2 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:34.057411 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:34.141184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83620b0a-0947-4e88-ab73-b3bfbe79ec5c None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:34.141478 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83620b0a-0947-4e88-ab73-b3bfbe79ec5c None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:34.141768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83620b0a-0947-4e88-ab73-b3bfbe79ec5c None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:34.143327 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 68/141] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:34.149182 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bd0e3-e0b8-4aa2-bf7f-5ff059d54e27 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:34.149480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bd0e3-e0b8-4aa2-bf7f-5ff059d54e27 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:34.149770 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bd0e3-e0b8-4aa2-bf7f-5ff059d54e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:34.151208 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed5de4-88c4-4eed-9c4b-760d04da5fb2 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:34.169467 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-ea2bd0e3-e0b8-4aa2-bf7f-5ff059d54e27 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:34.170681 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-ea2bd0e3-e0b8-4aa2-bf7f-5ff059d54e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:34.192921 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a795f2b-c2bb-4917-a037-e5de4438fa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:34.195233 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a795f2b-c2bb-4917-a037-e5de4438fa86 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:34.195685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a795f2b-c2bb-4917-a037-e5de4438fa86 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:34.196147 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a795f2b-c2bb-4917-a037-e5de4438fa86 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:34.197033 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a795f2b-c2bb-4917-a037-e5de4438fa86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:34.199053 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a795f2b-c2bb-4917-a037-e5de4438fa86 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:34.222827 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 74/142] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 14 11:47:34 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:47:34.254863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 69/143] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:34.280817 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a795f2b-c2bb-4917-a037-e5de4438fa86 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:34.404560 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:34.426864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a795f2b-c2bb-4917-a037-e5de4438fa86 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:34.476838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9df943-5721-4436-a338-06c9ae18a8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:34.477587 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9df943-5721-4436-a338-06c9ae18a8cb None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:34.477874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9df943-5721-4436-a338-06c9ae18a8cb None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:34.478154 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9df943-5721-4436-a338-06c9ae18a8cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:34.492213 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9df943-5721-4436-a338-06c9ae18a8cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-ce9df943-5721-4436-a338-06c9ae18a8cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:34.500341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:34.501449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:34.502410 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:34.502410 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:34.502410 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:34.502410 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:34.502410 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:34.502410 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:34.502410 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:34.502410 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:34.502410 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:34.502410 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:34.502410 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:34.502410 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:34.502410 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 75/144] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:34.508890 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2bd0e3-e0b8-4aa2-bf7f-5ff059d54e27 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:34.620986 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2bd0e3-e0b8-4aa2-bf7f-5ff059d54e27 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:34.634804 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:34.670067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c29cc-9470-43c1-a1d1-e104b5bad8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:34.670755 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c29cc-9470-43c1-a1d1-e104b5bad8b6 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:34.671041 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c29cc-9470-43c1-a1d1-e104b5bad8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:34.671320 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c29cc-9470-43c1-a1d1-e104b5bad8b6 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:34.672109 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c29cc-9470-43c1-a1d1-e104b5bad8b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:34.672433 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c29cc-9470-43c1-a1d1-e104b5bad8b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:34.673819 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c29cc-9470-43c1-a1d1-e104b5bad8b6 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:34.690364 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 70/145] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:34.697349 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9df943-5721-4436-a338-06c9ae18a8cb None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:34.820024 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9df943-5721-4436-a338-06c9ae18a8cb None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:34.864613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931af77-8dc3-4e49-9aa0-ecf371c35b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:34.865592 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931af77-8dc3-4e49-9aa0-ecf371c35b38 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:34.865927 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931af77-8dc3-4e49-9aa0-ecf371c35b38 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:34.866210 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931af77-8dc3-4e49-9aa0-ecf371c35b38 None admin] PATH_INFO: `/v3/users/ada5391afd8e4791ba751c6c05eaba9d` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:34.867508 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931af77-8dc3-4e49-9aa0-ecf371c35b38 None admin] RBAC: Authorizing `identity:get_user(user_id=ada5391afd8e4791ba751c6c05eaba9d)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:34.869091 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931af77-8dc3-4e49-9aa0-ecf371c35b38 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:34.870734 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 76/146] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:34 2022] GET /identity/v3/users/ada5391afd8e4791ba751c6c05eaba9d => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:34.876330 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c29cc-9470-43c1-a1d1-e104b5bad8b6 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:34.944359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4e13c-e045-47b0-ba74-84e6b0bd92ef None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:34.944675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4e13c-e045-47b0-ba74-84e6b0bd92ef None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:34.944923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4e13c-e045-47b0-ba74-84e6b0bd92ef None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:34.946546 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 77/147] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:34.952450 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e64ed-dba7-4570-ac01-deda7bb4e676 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:34.952749 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e64ed-dba7-4570-ac01-deda7bb4e676 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:34.953044 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e64ed-dba7-4570-ac01-deda7bb4e676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:34.974081 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-290e64ed-dba7-4570-ac01-deda7bb4e676 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:34.975943 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-290e64ed-dba7-4570-ac01-deda7bb4e676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:34.988893 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:35.035847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c29cc-9470-43c1-a1d1-e104b5bad8b6 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:35.065753 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 78/148] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:35.099170 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e64ed-dba7-4570-ac01-deda7bb4e676 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:35.105619 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af36543-5325-4d73-aba3-923faa94494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:35.106503 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af36543-5325-4d73-aba3-923faa94494c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:35.106789 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af36543-5325-4d73-aba3-923faa94494c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:35.107069 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af36543-5325-4d73-aba3-923faa94494c None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:35.108310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af36543-5325-4d73-aba3-923faa94494c None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:35.109787 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af36543-5325-4d73-aba3-923faa94494c None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:35.111687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 71/149] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:34 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:35.117090 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af36543-5325-4d73-aba3-923faa94494c None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:35.203733 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:35.303926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e64ed-dba7-4570-ac01-deda7bb4e676 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:35.313796 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af36543-5325-4d73-aba3-923faa94494c None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:35.370719 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d026b6-9711-4e5e-8d4b-ffc393ef6adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:35.371539 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d026b6-9711-4e5e-8d4b-ffc393ef6adc None admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:35.371832 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d026b6-9711-4e5e-8d4b-ffc393ef6adc None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:35.372142 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d026b6-9711-4e5e-8d4b-ffc393ef6adc None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172/users/ada5391afd8e4791ba751c6c05eaba9d/roles/478bbce5a7b34a23aabf38a0d1789a54` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:35.375379 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d026b6-9711-4e5e-8d4b-ffc393ef6adc None admin] RBAC: Authorizing `identity:create_grant(project_id=d9040b944c534111b0b4718481683172, user_id=ada5391afd8e4791ba751c6c05eaba9d, role_id=478bbce5a7b34a23aabf38a0d1789a54)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:35.376865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d026b6-9711-4e5e-8d4b-ffc393ef6adc None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:35.392662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef626fcc-4b8e-4d62-aee5-6e5147a60a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:35.393480 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef626fcc-4b8e-4d62-aee5-6e5147a60a7b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:35.393768 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef626fcc-4b8e-4d62-aee5-6e5147a60a7b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:35.394048 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef626fcc-4b8e-4d62-aee5-6e5147a60a7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:35.402202 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 72/150] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:47:35 2022] PUT /identity/v3/projects/d9040b944c534111b0b4718481683172/users/ada5391afd8e4791ba751c6c05eaba9d/roles/478bbce5a7b34a23aabf38a0d1789a54 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:47:35.414782 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef626fcc-4b8e-4d62-aee5-6e5147a60a7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-ef626fcc-4b8e-4d62-aee5-6e5147a60a7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:35.423466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:35.424343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:35.425086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:35.425086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:35.425086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:35.425086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:35.425086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:35.425086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:35.425086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:35.425086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:35.425086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:35.425086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:35.425086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:35.425086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:35.425086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 79/151] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:47:35.431978 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d026b6-9711-4e5e-8d4b-ffc393ef6adc None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:35.573251 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d026b6-9711-4e5e-8d4b-ffc393ef6adc None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:35.576230 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:35.614600 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c88e3-6ca7-4e76-a55b-2c971c989b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:35.615374 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c88e3-6ca7-4e76-a55b-2c971c989b84 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:35.615863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c88e3-6ca7-4e76-a55b-2c971c989b84 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:35.616182 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c88e3-6ca7-4e76-a55b-2c971c989b84 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:35.616960 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c88e3-6ca7-4e76-a55b-2c971c989b84 None admin] RBAC: Adding query filter params (name=member) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:35.617278 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c88e3-6ca7-4e76-a55b-2c971c989b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:35.618697 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c88e3-6ca7-4e76-a55b-2c971c989b84 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:35.628955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 73/152] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:35.634861 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef626fcc-4b8e-4d62-aee5-6e5147a60a7b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:35.650273 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:35.772757 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef626fcc-4b8e-4d62-aee5-6e5147a60a7b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:35.823334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9b5ba-de64-42b3-999f-015495af35ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:35.824254 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9b5ba-de64-42b3-999f-015495af35ab None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:35.824539 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9b5ba-de64-42b3-999f-015495af35ab None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:35.824816 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9b5ba-de64-42b3-999f-015495af35ab None admin] PATH_INFO: `/v3/users/9c838dd213e94d348715998fbd4b45b9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:35.826345 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9b5ba-de64-42b3-999f-015495af35ab None admin] RBAC: Authorizing `identity:get_user(user_id=9c838dd213e94d348715998fbd4b45b9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:35.827804 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9b5ba-de64-42b3-999f-015495af35ab None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:35.829461 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 80/153] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:35 2022] GET /identity/v3/users/9c838dd213e94d348715998fbd4b45b9 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:35.835863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c88e3-6ca7-4e76-a55b-2c971c989b84 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:35.973862 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c88e3-6ca7-4e76-a55b-2c971c989b84 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:36.014578 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d90639-0708-46b5-9db6-0b62f37b409c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:36.015632 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d90639-0708-46b5-9db6-0b62f37b409c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:36.016160 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d90639-0708-46b5-9db6-0b62f37b409c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:36.016644 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d90639-0708-46b5-9db6-0b62f37b409c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:36.055487 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:36.102100 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d90639-0708-46b5-9db6-0b62f37b409c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:36.104008 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d90639-0708-46b5-9db6-0b62f37b409c None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:36.245641 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 74/154] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:36.257053 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9b5ba-de64-42b3-999f-015495af35ab None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:36.361072 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:36.399933 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9b5ba-de64-42b3-999f-015495af35ab None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:36.444623 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a77e7f-8ac3-4c3f-9bd9-3c0374693861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:36.445490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a77e7f-8ac3-4c3f-9bd9-3c0374693861 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:36.445775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a77e7f-8ac3-4c3f-9bd9-3c0374693861 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:36.446051 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a77e7f-8ac3-4c3f-9bd9-3c0374693861 None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:36.450180 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a77e7f-8ac3-4c3f-9bd9-3c0374693861 None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:36.451650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a77e7f-8ac3-4c3f-9bd9-3c0374693861 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:36.453383 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 81/155] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:36 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:36.460441 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d90639-0708-46b5-9db6-0b62f37b409c None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:36.561016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:36.610396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d90639-0708-46b5-9db6-0b62f37b409c None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:36.660244 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3395ee-65f1-45b6-991a-0d950f94156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:36.660964 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3395ee-65f1-45b6-991a-0d950f94156b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:36.661254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3395ee-65f1-45b6-991a-0d950f94156b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:36.661601 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3395ee-65f1-45b6-991a-0d950f94156b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:36.662696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3395ee-65f1-45b6-991a-0d950f94156b None admin] RBAC: Adding query filter params (role.id=7b517960be1c437d850537c7e0aa985a, scope.project.id=d9040b944c534111b0b4718481683172, user.id=9c838dd213e94d348715998fbd4b45b9) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:36.663010 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3395ee-65f1-45b6-991a-0d950f94156b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:36.664566 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3395ee-65f1-45b6-991a-0d950f94156b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:36.671795 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 75/156] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:36 2022] GET /identity/v3/role_assignments?user.id=9c838dd213e94d348715998fbd4b45b9&scope.project.id=d9040b944c534111b0b4718481683172&role.id=7b517960be1c437d850537c7e0aa985a => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:37.696285 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73b198-d2df-4cd6-9bee-db31271c805e None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:37.696832 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73b198-d2df-4cd6-9bee-db31271c805e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:37.696832 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73b198-d2df-4cd6-9bee-db31271c805e None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:37.698480 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 82/157] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:37.704309 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eed7ec-555b-423f-a7c0-7f24662093d3 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:37.704820 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eed7ec-555b-423f-a7c0-7f24662093d3 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:37.704890 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eed7ec-555b-423f-a7c0-7f24662093d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:37.711565 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446dc1e-2d19-4683-ac77-fb9e91d299d4 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:37.711855 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446dc1e-2d19-4683-ac77-fb9e91d299d4 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:37.712318 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446dc1e-2d19-4683-ac77-fb9e91d299d4 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:37.715063 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 83/158] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:37.720418 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e501f4-c807-4e50-9327-0284b962749b None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:37.726648 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e501f4-c807-4e50-9327-0284b962749b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:37.727301 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e501f4-c807-4e50-9327-0284b962749b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:37.741569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-a2eed7ec-555b-423f-a7c0-7f24662093d3 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:37.742935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-a2eed7ec-555b-423f-a7c0-7f24662093d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:37.761252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-81e501f4-c807-4e50-9327-0284b962749b None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:37.762869 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-81e501f4-c807-4e50-9327-0284b962749b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:37.885445 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 76/159] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:37.926263 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 84/160] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:37.928071 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eed7ec-555b-423f-a7c0-7f24662093d3 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:37.973856 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e501f4-c807-4e50-9327-0284b962749b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:38.016654 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:38.096655 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eed7ec-555b-423f-a7c0-7f24662093d3 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:38.120833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:38.173750 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e501f4-c807-4e50-9327-0284b962749b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:38.177655 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1038f2-0e64-4e5c-9dd9-4d1888c99420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:38.178638 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1038f2-0e64-4e5c-9dd9-4d1888c99420 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:38.179064 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1038f2-0e64-4e5c-9dd9-4d1888c99420 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:38.179480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1038f2-0e64-4e5c-9dd9-4d1888c99420 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:38.199486 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1038f2-0e64-4e5c-9dd9-4d1888c99420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-9f1038f2-0e64-4e5c-9dd9-4d1888c99420 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:38.216627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:38.217717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:38.218457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:38.218457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:38.218457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:38.218457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:38.218457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:38.218457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:38.218457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:38.218457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:38.218457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:38.218457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:38.218457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:38.218457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:47:38.222793 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 77/161] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:47:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:38.225198 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf891590-bebd-49f7-8368-160f018105f9 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:38.225865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf891590-bebd-49f7-8368-160f018105f9 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:38.227073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf891590-bebd-49f7-8368-160f018105f9 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:38.228772 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 78/162] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:38.230829 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf891590-bebd-49f7-8368-160f018105f9 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:38.239281 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a69512-bddc-4866-b775-aedb792633f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:38.242221 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a69512-bddc-4866-b775-aedb792633f0 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:38.248325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a69512-bddc-4866-b775-aedb792633f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:38.248797 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a69512-bddc-4866-b775-aedb792633f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:38.269412 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a69512-bddc-4866-b775-aedb792633f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-37a69512-bddc-4866-b775-aedb792633f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:38.284758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:38.285763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:38.286740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:38.286740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:38.286740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:38.286740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:38.286740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:38.286740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:38.286740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:38.286740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:38.286740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:38.286740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:38.286740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:38.286740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:38.289442 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 85/163] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:47:38.290843 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c765d-d4b7-4a63-a5da-456a69e427bb None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:38.291452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c765d-d4b7-4a63-a5da-456a69e427bb None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:38.291930 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c765d-d4b7-4a63-a5da-456a69e427bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:38.310270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-6d1c765d-d4b7-4a63-a5da-456a69e427bb None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:38.311930 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6d1c765d-d4b7-4a63-a5da-456a69e427bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:38.418914 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 86/164] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:38.419798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c765d-d4b7-4a63-a5da-456a69e427bb None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:38.521781 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf891590-bebd-49f7-8368-160f018105f9 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:38.531793 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:38.568894 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:38.617159 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c765d-d4b7-4a63-a5da-456a69e427bb None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:38.620576 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7c0c4-b8c7-4f05-ba30-75491dc6dfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:38.621263 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7c0c4-b8c7-4f05-ba30-75491dc6dfdc None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:38.621552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7c0c4-b8c7-4f05-ba30-75491dc6dfdc None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:38.621879 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7c0c4-b8c7-4f05-ba30-75491dc6dfdc None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:38.622596 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7c0c4-b8c7-4f05-ba30-75491dc6dfdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:38.622906 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7c0c4-b8c7-4f05-ba30-75491dc6dfdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:38.624514 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7c0c4-b8c7-4f05-ba30-75491dc6dfdc None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:38.650327 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 79/165] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:38.651010 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7c0c4-b8c7-4f05-ba30-75491dc6dfdc None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:38.692007 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2447e75-47d1-48e6-8e24-4d07a467b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:38.693553 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2447e75-47d1-48e6-8e24-4d07a467b312 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:38.693891 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2447e75-47d1-48e6-8e24-4d07a467b312 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:38.694165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2447e75-47d1-48e6-8e24-4d07a467b312 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:38.694935 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2447e75-47d1-48e6-8e24-4d07a467b312 None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:38.695244 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2447e75-47d1-48e6-8e24-4d07a467b312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:38.696650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2447e75-47d1-48e6-8e24-4d07a467b312 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:38.721144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 87/166] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:38.722041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2447e75-47d1-48e6-8e24-4d07a467b312 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:38.858754 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7c0c4-b8c7-4f05-ba30-75491dc6dfdc None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:38.927946 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24368b-cf83-4455-9a2f-edf7c2993725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:38.928795 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24368b-cf83-4455-9a2f-edf7c2993725 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:38.929088 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24368b-cf83-4455-9a2f-edf7c2993725 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:38.929375 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24368b-cf83-4455-9a2f-edf7c2993725 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:38.954700 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24368b-cf83-4455-9a2f-edf7c2993725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-3e24368b-cf83-4455-9a2f-edf7c2993725 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:38.963713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:38.964626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:38.965370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:38.965370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:38.965370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:38.965370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:38.965370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:38.965370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:38.965370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:38.965370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:38.965370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:38.965370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:38.965370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:47:38.965370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:47:38.973904 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 80/167] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:47:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:38.974890 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24368b-cf83-4455-9a2f-edf7c2993725 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:39.008502 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2447e75-47d1-48e6-8e24-4d07a467b312 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:39.073908 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:39.080303 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:39.099828 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71679f38-5c5c-46bc-ae24-8e30762713bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:39.100742 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71679f38-5c5c-46bc-ae24-8e30762713bf None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:39.101032 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71679f38-5c5c-46bc-ae24-8e30762713bf None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:39.101311 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71679f38-5c5c-46bc-ae24-8e30762713bf None admin] PATH_INFO: `/v3/users/e96f467bcdaf40f288963da3024186a8` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:39.103235 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71679f38-5c5c-46bc-ae24-8e30762713bf None admin] RBAC: Authorizing `identity:get_user(user_id=e96f467bcdaf40f288963da3024186a8)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:39.104724 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71679f38-5c5c-46bc-ae24-8e30762713bf None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:39.109315 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 88/168] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:38 2022] GET /identity/v3/users/e96f467bcdaf40f288963da3024186a8 => generated 247 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:39.110079 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71679f38-5c5c-46bc-ae24-8e30762713bf None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:39.149656 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24368b-cf83-4455-9a2f-edf7c2993725 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:39.191038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe546b8-1321-4965-82d9-9b4cefb76aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:39.192582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe546b8-1321-4965-82d9-9b4cefb76aa7 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:39.197705 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe546b8-1321-4965-82d9-9b4cefb76aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:39.198182 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe546b8-1321-4965-82d9-9b4cefb76aa7 None admin] PATH_INFO: `/v3/users/9c838dd213e94d348715998fbd4b45b9` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:39.199723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe546b8-1321-4965-82d9-9b4cefb76aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=9c838dd213e94d348715998fbd4b45b9)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:39.201361 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe546b8-1321-4965-82d9-9b4cefb76aa7 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:39.205021 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 81/169] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:38 2022] GET /identity/v3/users/9c838dd213e94d348715998fbd4b45b9 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:39.208199 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9a19c-7de2-4be1-8931-c8c8be3e0d6c None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:39.209347 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9a19c-7de2-4be1-8931-c8c8be3e0d6c None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:39.209944 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9a19c-7de2-4be1-8931-c8c8be3e0d6c None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:39.212962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 82/170] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:39.215620 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9a19c-7de2-4be1-8931-c8c8be3e0d6c None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:39.321849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71679f38-5c5c-46bc-ae24-8e30762713bf None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:39.401581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9a19c-7de2-4be1-8931-c8c8be3e0d6c None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:39.411774 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:39.416623 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a31657-8e14-4013-92d4-813dcc9c0fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:39.417322 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a31657-8e14-4013-92d4-813dcc9c0fb2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:39.417609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a31657-8e14-4013-92d4-813dcc9c0fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:39.417891 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a31657-8e14-4013-92d4-813dcc9c0fb2 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:39.418654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a31657-8e14-4013-92d4-813dcc9c0fb2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:39.418966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a31657-8e14-4013-92d4-813dcc9c0fb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:39.420416 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a31657-8e14-4013-92d4-813dcc9c0fb2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:39.432130 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 89/171] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:47:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:39.433597 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a31657-8e14-4013-92d4-813dcc9c0fb2 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:39.444711 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eafd19-93bf-4d97-a988-1e3ccac02e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:39.446073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eafd19-93bf-4d97-a988-1e3ccac02e9d None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:39.446508 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eafd19-93bf-4d97-a988-1e3ccac02e9d None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:39.446933 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eafd19-93bf-4d97-a988-1e3ccac02e9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:39.501577 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:39.540283 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eafd19-93bf-4d97-a988-1e3ccac02e9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:39.542188 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eafd19-93bf-4d97-a988-1e3ccac02e9d None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:39.568514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a31657-8e14-4013-92d4-813dcc9c0fb2 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:39.609038 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db690e3-b837-4b5a-a235-7fc5c30e3de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:39.609693 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db690e3-b837-4b5a-a235-7fc5c30e3de1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:39.609978 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db690e3-b837-4b5a-a235-7fc5c30e3de1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:39.610255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db690e3-b837-4b5a-a235-7fc5c30e3de1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:39.674634 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 83/172] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:39.675710 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cfe45-7823-4cc0-a49b-2de6fd03dbe0 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:39.676030 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cfe45-7823-4cc0-a49b-2de6fd03dbe0 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:39.676332 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cfe45-7823-4cc0-a49b-2de6fd03dbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:39.686913 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db690e3-b837-4b5a-a235-7fc5c30e3de1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:39.688436 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db690e3-b837-4b5a-a235-7fc5c30e3de1 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:39.694081 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-9e8cfe45-7823-4cc0-a49b-2de6fd03dbe0 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:39.695288 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-9e8cfe45-7823-4cc0-a49b-2de6fd03dbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:39.700574 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:39.747400 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:39.774389 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 84/173] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:39.775725 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33038625-dfb2-46ce-8385-458a9e2e88dd None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:39.776059 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33038625-dfb2-46ce-8385-458a9e2e88dd None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:39.776340 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33038625-dfb2-46ce-8385-458a9e2e88dd None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:39.777740 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 85/174] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:39.782400 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33038625-dfb2-46ce-8385-458a9e2e88dd None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:39.812538 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 90/175] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:39.818046 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804da013-2294-4266-986f-6ede21c593d1 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:39.818320 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804da013-2294-4266-986f-6ede21c593d1 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:39.818600 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804da013-2294-4266-986f-6ede21c593d1 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:39.819953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 91/176] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:39.820658 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804da013-2294-4266-986f-6ede21c593d1 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:39.906140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33038625-dfb2-46ce-8385-458a9e2e88dd None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:39.927362 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804da013-2294-4266-986f-6ede21c593d1 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:39.941541 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042040d-06d7-499f-a8ef-8498667922f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:39.943531 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042040d-06d7-499f-a8ef-8498667922f7 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:39.943819 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042040d-06d7-499f-a8ef-8498667922f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:39.944137 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042040d-06d7-499f-a8ef-8498667922f7 None admin] PATH_INFO: `/v3/users/9c838dd213e94d348715998fbd4b45b9` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:39.945344 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042040d-06d7-499f-a8ef-8498667922f7 None admin] RBAC: Authorizing `identity:get_user(user_id=9c838dd213e94d348715998fbd4b45b9)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:39.946811 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042040d-06d7-499f-a8ef-8498667922f7 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:39.948663 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 86/177] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:39 2022] GET /identity/v3/users/9c838dd213e94d348715998fbd4b45b9 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:39.949773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0de08f-0087-4357-8ce9-c43b9d81b8f3 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:39.950068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0de08f-0087-4357-8ce9-c43b9d81b8f3 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:39.950351 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0de08f-0087-4357-8ce9-c43b9d81b8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:39.961417 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:39.967115 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570ca14-7c34-45e0-bc82-aa9c36769ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:39.967280 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-9e0de08f-0087-4357-8ce9-c43b9d81b8f3 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:39.968025 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570ca14-7c34-45e0-bc82-aa9c36769ef9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:39.968317 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570ca14-7c34-45e0-bc82-aa9c36769ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:39.968406 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-9e0de08f-0087-4357-8ce9-c43b9d81b8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:39.968600 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570ca14-7c34-45e0-bc82-aa9c36769ef9 None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:39.969772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570ca14-7c34-45e0-bc82-aa9c36769ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:39.971265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570ca14-7c34-45e0-bc82-aa9c36769ef9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:39.973165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 92/178] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:39 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:39.973766 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570ca14-7c34-45e0-bc82-aa9c36769ef9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:39.994936 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:40.043436 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 87/179] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:40.044867 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70fdcf-1ecb-4047-a417-afd9f6cd5501 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:40.045160 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70fdcf-1ecb-4047-a417-afd9f6cd5501 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:40.045439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70fdcf-1ecb-4047-a417-afd9f6cd5501 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:40.046699 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 88/180] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:40.049839 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70fdcf-1ecb-4047-a417-afd9f6cd5501 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:40.082074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570ca14-7c34-45e0-bc82-aa9c36769ef9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:40.116887 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72842cc8-af97-4b9a-abfe-89d55b8ecb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:40.117683 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72842cc8-af97-4b9a-abfe-89d55b8ecb08 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:40.117969 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72842cc8-af97-4b9a-abfe-89d55b8ecb08 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:40.118244 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72842cc8-af97-4b9a-abfe-89d55b8ecb08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:40.129527 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72842cc8-af97-4b9a-abfe-89d55b8ecb08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-72842cc8-af97-4b9a-abfe-89d55b8ecb08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:40.137513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:40.138509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:40.139292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:40.139292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:40.139292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:40.139292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:40.139292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:40.139292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:40.139292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:40.139292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:40.139292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:40.139292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:40.139292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:40.139292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:40.139292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 93/181] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:47:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:40.139982 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0bcef-f269-4a10-ba04-9c981f61eba5 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:40.140378 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0bcef-f269-4a10-ba04-9c981f61eba5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:40.140649 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0bcef-f269-4a10-ba04-9c981f61eba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:40.154625 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70fdcf-1ecb-4047-a417-afd9f6cd5501 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:40.157952 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-acc0bcef-f269-4a10-ba04-9c981f61eba5 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:40.159187 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-acc0bcef-f269-4a10-ba04-9c981f61eba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:40.193491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6050c2-4061-4ecf-823e-af05e1760ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:40.194372 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6050c2-4061-4ecf-823e-af05e1760ee6 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:40.194585 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6050c2-4061-4ecf-823e-af05e1760ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:40.194868 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6050c2-4061-4ecf-823e-af05e1760ee6 None admin] PATH_INFO: `/v3/projects/ea34c06a1c95494ab3e568dcaf9f9ee2` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:40.196100 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6050c2-4061-4ecf-823e-af05e1760ee6 None admin] RBAC: Authorizing `identity:get_project(project_id=ea34c06a1c95494ab3e568dcaf9f9ee2)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:40.197568 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6050c2-4061-4ecf-823e-af05e1760ee6 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:40.199264 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 89/182] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:40 2022] GET /identity/v3/projects/ea34c06a1c95494ab3e568dcaf9f9ee2 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:40.200063 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6050c2-4061-4ecf-823e-af05e1760ee6 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:40.204165 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:40.230523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 94/183] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:40.231299 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0bcef-f269-4a10-ba04-9c981f61eba5 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:40.246874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:40.305125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6050c2-4061-4ecf-823e-af05e1760ee6 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:40.338338 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0bcef-f269-4a10-ba04-9c981f61eba5 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:40.340152 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cd2a4-8008-4ac6-a0e6-96ca4743c38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:40.340814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cd2a4-8008-4ac6-a0e6-96ca4743c38c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:40.341098 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cd2a4-8008-4ac6-a0e6-96ca4743c38c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:40.341377 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cd2a4-8008-4ac6-a0e6-96ca4743c38c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:40.372671 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8c548-56a4-4ba2-87de-b735249822c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:40.373320 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8c548-56a4-4ba2-87de-b735249822c1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:40.373604 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8c548-56a4-4ba2-87de-b735249822c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:40.373881 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8c548-56a4-4ba2-87de-b735249822c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:40.374705 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8c548-56a4-4ba2-87de-b735249822c1 None admin] RBAC: Adding query filter params (role.id=321ee52ce1bc4eafa201f23f55f23d2b, scope.project.id=d9040b944c534111b0b4718481683172, user.id=e96f467bcdaf40f288963da3024186a8) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:40.375022 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8c548-56a4-4ba2-87de-b735249822c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:40.376504 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8c548-56a4-4ba2-87de-b735249822c1 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:40.383856 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 95/184] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:40 2022] GET /identity/v3/role_assignments?user.id=e96f467bcdaf40f288963da3024186a8&scope.project.id=d9040b944c534111b0b4718481683172&role.id=321ee52ce1bc4eafa201f23f55f23d2b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:40.389450 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62b779-b0cc-460e-9f0a-45d61219b6fc None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:40.389859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62b779-b0cc-460e-9f0a-45d61219b6fc None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:40.390202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62b779-b0cc-460e-9f0a-45d61219b6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:40.408561 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-9d62b779-b0cc-460e-9f0a-45d61219b6fc None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:40.409752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9d62b779-b0cc-460e-9f0a-45d61219b6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:40.417015 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cd2a4-8008-4ac6-a0e6-96ca4743c38c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:40.418534 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cd2a4-8008-4ac6-a0e6-96ca4743c38c None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:40.422694 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:40.494201 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 96/185] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:40.496039 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62b779-b0cc-460e-9f0a-45d61219b6fc None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:40.505769 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:40.544041 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 90/186] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:40.545215 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cd2a4-8008-4ac6-a0e6-96ca4743c38c None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:40.630355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62b779-b0cc-460e-9f0a-45d61219b6fc None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:40.664141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cd2a4-8008-4ac6-a0e6-96ca4743c38c None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:40.666513 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:40.668910 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb05521-b443-44ea-bf9c-2a9bb9f47886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:40.669920 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb05521-b443-44ea-bf9c-2a9bb9f47886 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:40.670212 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb05521-b443-44ea-bf9c-2a9bb9f47886 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:40.670498 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb05521-b443-44ea-bf9c-2a9bb9f47886 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:40.681202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb05521-b443-44ea-bf9c-2a9bb9f47886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-7fb05521-b443-44ea-bf9c-2a9bb9f47886 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:40.688966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:40.689986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:40.690964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:40.690964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:40.690964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:40.690964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:40.690964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:40.690964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:40.690964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:40.690964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:40.690964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:40.690964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:40.690964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:40.690964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:40.690964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 97/187] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:40.690964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb05521-b443-44ea-bf9c-2a9bb9f47886 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:40.701680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc1bc5-2fe8-46ca-b5c3-14b6d5197e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:40.702353 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc1bc5-2fe8-46ca-b5c3-14b6d5197e42 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:40.702734 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc1bc5-2fe8-46ca-b5c3-14b6d5197e42 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:40.703022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc1bc5-2fe8-46ca-b5c3-14b6d5197e42 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:40.703776 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc1bc5-2fe8-46ca-b5c3-14b6d5197e42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:40.704135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc1bc5-2fe8-46ca-b5c3-14b6d5197e42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:40.705529 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc1bc5-2fe8-46ca-b5c3-14b6d5197e42 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:40.714508 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 91/188] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:40.715302 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc1bc5-2fe8-46ca-b5c3-14b6d5197e42 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:40.755871 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:40.794906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb05521-b443-44ea-bf9c-2a9bb9f47886 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:40.823269 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc1bc5-2fe8-46ca-b5c3-14b6d5197e42 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:40.828369 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd9448-a69e-4001-9716-04ab0b128f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:40.829020 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd9448-a69e-4001-9716-04ab0b128f4a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:40.829302 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd9448-a69e-4001-9716-04ab0b128f4a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:40.829579 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd9448-a69e-4001-9716-04ab0b128f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:40.830403 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd9448-a69e-4001-9716-04ab0b128f4a None admin] RBAC: Adding query filter params (role.id=7b517960be1c437d850537c7e0aa985a, scope.project.id=ea34c06a1c95494ab3e568dcaf9f9ee2, user.id=9c838dd213e94d348715998fbd4b45b9) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:40.830715 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd9448-a69e-4001-9716-04ab0b128f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:40.832199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd9448-a69e-4001-9716-04ab0b128f4a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:40.838978 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 98/189] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:40 2022] GET /identity/v3/role_assignments?user.id=9c838dd213e94d348715998fbd4b45b9&scope.project.id=ea34c06a1c95494ab3e568dcaf9f9ee2&role.id=7b517960be1c437d850537c7e0aa985a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:40.850323 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd9448-a69e-4001-9716-04ab0b128f4a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:40.861121 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a5363-3a27-43a4-ac58-b868ba31b694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:40.862384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a5363-3a27-43a4-ac58-b868ba31b694 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:40.862675 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a5363-3a27-43a4-ac58-b868ba31b694 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:40.862960 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a5363-3a27-43a4-ac58-b868ba31b694 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:40.864999 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a5363-3a27-43a4-ac58-b868ba31b694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:40.866540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a5363-3a27-43a4-ac58-b868ba31b694 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:40.868533 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 92/190] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:40.869266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a5363-3a27-43a4-ac58-b868ba31b694 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:40.920146 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:40.982226 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd9448-a69e-4001-9716-04ab0b128f4a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:41.005819 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a5363-3a27-43a4-ac58-b868ba31b694 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:41.011431 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:41.020401 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ac47b-6798-4b25-99ed-87f7b6af91ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:41.021517 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ac47b-6798-4b25-99ed-87f7b6af91ac None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:41.021809 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ac47b-6798-4b25-99ed-87f7b6af91ac None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:41.022093 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ac47b-6798-4b25-99ed-87f7b6af91ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:41.032986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ac47b-6798-4b25-99ed-87f7b6af91ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-1e0ac47b-6798-4b25-99ed-87f7b6af91ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:41.042540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:41.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:41.044731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:41.044731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:41.044731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:41.044731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:41.044731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:41.044731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:41.044731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:41.044731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:41.044731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:41.044731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:41.044731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:47:41.044731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:41.044731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 99/191] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:47:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:41.044731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ac47b-6798-4b25-99ed-87f7b6af91ac None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:41.051750 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3fe8b-e2a0-45de-8a09-afaf1f7fc2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:41.052437 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3fe8b-e2a0-45de-8a09-afaf1f7fc2cd None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:41.053631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3fe8b-e2a0-45de-8a09-afaf1f7fc2cd None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:41.053631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3fe8b-e2a0-45de-8a09-afaf1f7fc2cd None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:41.054246 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3fe8b-e2a0-45de-8a09-afaf1f7fc2cd None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:41.055700 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3fe8b-e2a0-45de-8a09-afaf1f7fc2cd None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:41.057440 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 93/192] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:40 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:41.058300 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3fe8b-e2a0-45de-8a09-afaf1f7fc2cd None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:41.167975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ac47b-6798-4b25-99ed-87f7b6af91ac None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:41.170217 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3fe8b-e2a0-45de-8a09-afaf1f7fc2cd None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:41.171748 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:41.204954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14eb7cb-9b43-430d-8f73-26019cc80c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:41.205626 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14eb7cb-9b43-430d-8f73-26019cc80c37 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:41.205919 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14eb7cb-9b43-430d-8f73-26019cc80c37 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:41.206203 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14eb7cb-9b43-430d-8f73-26019cc80c37 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:41.206951 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14eb7cb-9b43-430d-8f73-26019cc80c37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:41.207317 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14eb7cb-9b43-430d-8f73-26019cc80c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:41.209288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14eb7cb-9b43-430d-8f73-26019cc80c37 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:41.209435 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53396a16-7208-4ac0-81d6-0c0de14cee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:41.210312 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53396a16-7208-4ac0-81d6-0c0de14cee7b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:41.210605 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53396a16-7208-4ac0-81d6-0c0de14cee7b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:41.210944 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53396a16-7208-4ac0-81d6-0c0de14cee7b None admin] PATH_INFO: `/v3/users/e702a6132d68479fa19d935c4c4bbf5d` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:41.217485 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 100/193] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:41.218265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14eb7cb-9b43-430d-8f73-26019cc80c37 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:41.226386 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53396a16-7208-4ac0-81d6-0c0de14cee7b None admin] RBAC: Authorizing `identity:get_user(user_id=e702a6132d68479fa19d935c4c4bbf5d)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:41.227847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53396a16-7208-4ac0-81d6-0c0de14cee7b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:41.229582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 94/194] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:41 2022] GET /identity/v3/users/e702a6132d68479fa19d935c4c4bbf5d => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:41.230348 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53396a16-7208-4ac0-81d6-0c0de14cee7b None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:41.271997 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:41.324456 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14eb7cb-9b43-430d-8f73-26019cc80c37 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:41.338387 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53396a16-7208-4ac0-81d6-0c0de14cee7b None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:41.357849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e8d40-efb8-423c-a2b5-4a8535e1584a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:41.358518 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e8d40-efb8-423c-a2b5-4a8535e1584a None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:41.358804 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e8d40-efb8-423c-a2b5-4a8535e1584a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:41.359083 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e8d40-efb8-423c-a2b5-4a8535e1584a None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:41.359789 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e8d40-efb8-423c-a2b5-4a8535e1584a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:41.361269 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e8d40-efb8-423c-a2b5-4a8535e1584a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:41.374328 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6464a5-fafa-4e25-8c4b-8b937b8d8386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:41.375103 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6464a5-fafa-4e25-8c4b-8b937b8d8386 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:41.375388 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6464a5-fafa-4e25-8c4b-8b937b8d8386 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:41.375678 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6464a5-fafa-4e25-8c4b-8b937b8d8386 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:41.376504 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6464a5-fafa-4e25-8c4b-8b937b8d8386 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:41.376814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6464a5-fafa-4e25-8c4b-8b937b8d8386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:41.378196 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6464a5-fafa-4e25-8c4b-8b937b8d8386 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:41.382346 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 101/195] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 14 11:47:41 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:47:41.383179 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e8d40-efb8-423c-a2b5-4a8535e1584a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:41.387016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 95/196] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:47:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:41.387929 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6464a5-fafa-4e25-8c4b-8b937b8d8386 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:41.418777 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:41.514161 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6464a5-fafa-4e25-8c4b-8b937b8d8386 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:41.524935 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e8d40-efb8-423c-a2b5-4a8535e1584a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:41.532987 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:41.554198 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cdbd1-f7ad-41e1-affe-8eb9081d3795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:41.555191 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cdbd1-f7ad-41e1-affe-8eb9081d3795 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:41.555480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cdbd1-f7ad-41e1-affe-8eb9081d3795 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:41.555767 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cdbd1-f7ad-41e1-affe-8eb9081d3795 None admin] PATH_INFO: `/v3/users/ada5391afd8e4791ba751c6c05eaba9d` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:41.557061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cdbd1-f7ad-41e1-affe-8eb9081d3795 None admin] RBAC: Authorizing `identity:get_user(user_id=ada5391afd8e4791ba751c6c05eaba9d)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:41.558584 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cdbd1-f7ad-41e1-affe-8eb9081d3795 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:41.560290 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 96/197] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:41 2022] GET /identity/v3/users/ada5391afd8e4791ba751c6c05eaba9d => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:41.561096 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cdbd1-f7ad-41e1-affe-8eb9081d3795 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:41.571149 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52141b-317e-4a20-925d-fd092919f2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:41.571825 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52141b-317e-4a20-925d-fd092919f2ea None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:41.572149 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52141b-317e-4a20-925d-fd092919f2ea None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:41.572434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52141b-317e-4a20-925d-fd092919f2ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:41.573285 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52141b-317e-4a20-925d-fd092919f2ea None admin] RBAC: Adding query filter params (role.id=703199a2f03143128fbac7cc8481b912, scope.project.id=d9040b944c534111b0b4718481683172, user.id=9c838dd213e94d348715998fbd4b45b9) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:41.573606 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52141b-317e-4a20-925d-fd092919f2ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:41.575084 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52141b-317e-4a20-925d-fd092919f2ea None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:41.581913 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 102/198] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:41 2022] GET /identity/v3/role_assignments?user.id=9c838dd213e94d348715998fbd4b45b9&scope.project.id=d9040b944c534111b0b4718481683172&role.id=703199a2f03143128fbac7cc8481b912 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:41.583622 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52141b-317e-4a20-925d-fd092919f2ea None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:41.692536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:41.706725 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cdbd1-f7ad-41e1-affe-8eb9081d3795 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:41.726257 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52141b-317e-4a20-925d-fd092919f2ea None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:41.761344 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedcab9-cbaa-41e1-8cf7-92a16407f19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:41.762376 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedcab9-cbaa-41e1-8cf7-92a16407f19e None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:41.762727 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedcab9-cbaa-41e1-8cf7-92a16407f19e None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:41.763075 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedcab9-cbaa-41e1-8cf7-92a16407f19e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:41.780075 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7f6fd-c99d-4b34-adbd-f107fc49079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:41.780670 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7f6fd-c99d-4b34-adbd-f107fc49079c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:41.781152 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7f6fd-c99d-4b34-adbd-f107fc49079c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:41.781499 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7f6fd-c99d-4b34-adbd-f107fc49079c None admin] PATH_INFO: `/v3/users/e702a6132d68479fa19d935c4c4bbf5d` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:41.783090 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7f6fd-c99d-4b34-adbd-f107fc49079c None admin] RBAC: Authorizing `identity:get_user(user_id=e702a6132d68479fa19d935c4c4bbf5d)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:41.784674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7f6fd-c99d-4b34-adbd-f107fc49079c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:41.788489 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 103/199] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:41 2022] GET /identity/v3/users/e702a6132d68479fa19d935c4c4bbf5d => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:41.789436 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7f6fd-c99d-4b34-adbd-f107fc49079c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:41.837473 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:41.851624 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedcab9-cbaa-41e1-8cf7-92a16407f19e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:41.853146 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedcab9-cbaa-41e1-8cf7-92a16407f19e None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:41.966159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 97/200] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:41.967877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedcab9-cbaa-41e1-8cf7-92a16407f19e None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:41.977338 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7f6fd-c99d-4b34-adbd-f107fc49079c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:41.978344 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:42.024976 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661dd09-1c9c-404d-a9f6-eb887b892320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:42.026021 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661dd09-1c9c-404d-a9f6-eb887b892320 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:42.026544 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661dd09-1c9c-404d-a9f6-eb887b892320 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:42.027033 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661dd09-1c9c-404d-a9f6-eb887b892320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:42.105966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661dd09-1c9c-404d-a9f6-eb887b892320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:42.107331 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedcab9-cbaa-41e1-8cf7-92a16407f19e None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:42.107539 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661dd09-1c9c-404d-a9f6-eb887b892320 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:42.148383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875de0e1-e21c-4ba5-96d6-6c44e47d560d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:42.149442 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875de0e1-e21c-4ba5-96d6-6c44e47d560d None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:42.149990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875de0e1-e21c-4ba5-96d6-6c44e47d560d None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:42.150476 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875de0e1-e21c-4ba5-96d6-6c44e47d560d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:42.168448 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:42.227912 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 104/201] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:42.229499 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661dd09-1c9c-404d-a9f6-eb887b892320 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:42.232747 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:42.249191 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875de0e1-e21c-4ba5-96d6-6c44e47d560d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:42.250864 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875de0e1-e21c-4ba5-96d6-6c44e47d560d None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:42.354484 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661dd09-1c9c-404d-a9f6-eb887b892320 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:42.368276 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 98/202] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:42.369068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875de0e1-e21c-4ba5-96d6-6c44e47d560d None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:42.407268 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356658d-3112-48c3-a470-9762ac2f0870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:42.408442 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356658d-3112-48c3-a470-9762ac2f0870 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:42.408764 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356658d-3112-48c3-a470-9762ac2f0870 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:42.409887 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356658d-3112-48c3-a470-9762ac2f0870 None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:42.411295 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356658d-3112-48c3-a470-9762ac2f0870 None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:42.412809 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356658d-3112-48c3-a470-9762ac2f0870 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:42.415381 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 105/203] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:42 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:42.420733 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356658d-3112-48c3-a470-9762ac2f0870 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:42.433395 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:42.479540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:42.491992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875de0e1-e21c-4ba5-96d6-6c44e47d560d None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:42.531261 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18246f-be50-4ed5-817b-bcb8bcdd6e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:42.532615 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18246f-be50-4ed5-817b-bcb8bcdd6e7a None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:42.533108 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18246f-be50-4ed5-817b-bcb8bcdd6e7a None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:42.533586 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18246f-be50-4ed5-817b-bcb8bcdd6e7a None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:42.535131 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18246f-be50-4ed5-817b-bcb8bcdd6e7a None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:42.537482 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18246f-be50-4ed5-817b-bcb8bcdd6e7a None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:42.539461 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 99/204] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:42 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:42.540506 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18246f-be50-4ed5-817b-bcb8bcdd6e7a None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:42.568042 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356658d-3112-48c3-a470-9762ac2f0870 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:42.605793 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7ffa4-f3a8-4d54-9c82-ac4708158bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:42.607185 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7ffa4-f3a8-4d54-9c82-ac4708158bab None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:42.607784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7ffa4-f3a8-4d54-9c82-ac4708158bab None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:42.608297 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7ffa4-f3a8-4d54-9c82-ac4708158bab None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:42.609859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7ffa4-f3a8-4d54-9c82-ac4708158bab None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:42.611745 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7ffa4-f3a8-4d54-9c82-ac4708158bab None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:42.614251 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 106/205] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:42 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:42.615295 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7ffa4-f3a8-4d54-9c82-ac4708158bab None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:42.686521 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18246f-be50-4ed5-817b-bcb8bcdd6e7a None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:42.705384 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:42.727597 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97457662-ec20-4465-9663-1d87ae1bf9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:42.728758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97457662-ec20-4465-9663-1d87ae1bf9c3 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:42.729351 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97457662-ec20-4465-9663-1d87ae1bf9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:42.729829 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97457662-ec20-4465-9663-1d87ae1bf9c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:42.730886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97457662-ec20-4465-9663-1d87ae1bf9c3 None admin] RBAC: Adding query filter params (role.id=321ee52ce1bc4eafa201f23f55f23d2b, scope.project.id=3bab82494d694b8db2b6698451bdf404, user.id=e702a6132d68479fa19d935c4c4bbf5d) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:42.731423 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97457662-ec20-4465-9663-1d87ae1bf9c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:42.733134 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97457662-ec20-4465-9663-1d87ae1bf9c3 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:42.741384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 100/206] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:42 2022] GET /identity/v3/role_assignments?user.id=e702a6132d68479fa19d935c4c4bbf5d&scope.project.id=3bab82494d694b8db2b6698451bdf404&role.id=321ee52ce1bc4eafa201f23f55f23d2b => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:42.742891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97457662-ec20-4465-9663-1d87ae1bf9c3 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:42.745595 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7ffa4-f3a8-4d54-9c82-ac4708158bab None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:42.794982 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:42.824179 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79caf8-2eed-47e0-94f6-f3558a37e08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:42.824978 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79caf8-2eed-47e0-94f6-f3558a37e08c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:42.825275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79caf8-2eed-47e0-94f6-f3558a37e08c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:42.825555 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79caf8-2eed-47e0-94f6-f3558a37e08c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:42.826483 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79caf8-2eed-47e0-94f6-f3558a37e08c None admin] RBAC: Adding query filter params (role.id=478bbce5a7b34a23aabf38a0d1789a54, scope.project.id=d9040b944c534111b0b4718481683172, user.id=ada5391afd8e4791ba751c6c05eaba9d) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:42.826815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79caf8-2eed-47e0-94f6-f3558a37e08c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:42.828499 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79caf8-2eed-47e0-94f6-f3558a37e08c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:42.842012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 107/207] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:42 2022] GET /identity/v3/role_assignments?user.id=ada5391afd8e4791ba751c6c05eaba9d&scope.project.id=d9040b944c534111b0b4718481683172&role.id=478bbce5a7b34a23aabf38a0d1789a54 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:42.944088 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97457662-ec20-4465-9663-1d87ae1bf9c3 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:42.997509 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fe1e4-0f71-4262-9fa4-77f6106e32ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:42.998315 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fe1e4-0f71-4262-9fa4-77f6106e32ea None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:42.998557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fe1e4-0f71-4262-9fa4-77f6106e32ea None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:42.998892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fe1e4-0f71-4262-9fa4-77f6106e32ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:42.999755 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fe1e4-0f71-4262-9fa4-77f6106e32ea None admin] RBAC: Adding query filter params (role.id=703199a2f03143128fbac7cc8481b912, scope.project.id=3bab82494d694b8db2b6698451bdf404, user.id=e702a6132d68479fa19d935c4c4bbf5d) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:43.000109 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fe1e4-0f71-4262-9fa4-77f6106e32ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:43.001611 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fe1e4-0f71-4262-9fa4-77f6106e32ea None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:43.013388 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 101/208] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:42 2022] GET /identity/v3/role_assignments?user.id=e702a6132d68479fa19d935c4c4bbf5d&scope.project.id=3bab82494d694b8db2b6698451bdf404&role.id=703199a2f03143128fbac7cc8481b912 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:44.050146 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e08dbe-01f7-4d90-89a6-df5196eb880a None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:44.051067 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e08dbe-01f7-4d90-89a6-df5196eb880a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:44.051609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e08dbe-01f7-4d90-89a6-df5196eb880a None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:44.053566 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 108/209] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:44.059723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6c559-7f3e-4458-b6cd-6d6000a4aab0 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:44.060610 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6c559-7f3e-4458-b6cd-6d6000a4aab0 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:44.061039 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6c559-7f3e-4458-b6cd-6d6000a4aab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:44.065746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a097e-c436-436e-9ec4-6705aa351d05 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:44.066931 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a097e-c436-436e-9ec4-6705aa351d05 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:44.067435 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a097e-c436-436e-9ec4-6705aa351d05 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:44.069277 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 109/210] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:44.076782 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed818a6-7912-461e-b268-f0286bad58a6 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:44.077098 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed818a6-7912-461e-b268-f0286bad58a6 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:44.077366 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed818a6-7912-461e-b268-f0286bad58a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:44.087535 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-1fe6c559-7f3e-4458-b6cd-6d6000a4aab0 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:44.089115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-1fe6c559-7f3e-4458-b6cd-6d6000a4aab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:44.096417 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-5ed818a6-7912-461e-b268-f0286bad58a6 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:44.097921 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-5ed818a6-7912-461e-b268-f0286bad58a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:44.171586 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 102/211] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:44.185821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 110/212] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:44.209078 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed818a6-7912-461e-b268-f0286bad58a6 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:44.213727 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6c559-7f3e-4458-b6cd-6d6000a4aab0 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:44.237003 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:44.297937 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:44.337772 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6c559-7f3e-4458-b6cd-6d6000a4aab0 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:44.342920 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed818a6-7912-461e-b268-f0286bad58a6 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:44.383402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790579b-4442-452e-9e7c-6220acd37c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:44.384544 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790579b-4442-452e-9e7c-6220acd37c1c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:44.384833 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790579b-4442-452e-9e7c-6220acd37c1c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:44.385113 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790579b-4442-452e-9e7c-6220acd37c1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:44.386298 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790579b-4442-452e-9e7c-6220acd37c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:44.387756 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790579b-4442-452e-9e7c-6220acd37c1c None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:44.388519 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce993d1-cbf0-4b11-b274-8496bf300722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:44.389550 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce993d1-cbf0-4b11-b274-8496bf300722 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:44.390034 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce993d1-cbf0-4b11-b274-8496bf300722 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:44.390559 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce993d1-cbf0-4b11-b274-8496bf300722 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:44.394328 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 103/213] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:44.396132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790579b-4442-452e-9e7c-6220acd37c1c None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:44.405609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce993d1-cbf0-4b11-b274-8496bf300722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-9ce993d1-cbf0-4b11-b274-8496bf300722 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:44.417143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:44.418012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:44.418785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:44.418785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:44.418785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:44.418785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:44.418785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:44.418785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:44.418785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:44.418785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:44.418785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:44.418785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:44.418785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:44.418785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:44.427775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 111/214] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:44.429859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce993d1-cbf0-4b11-b274-8496bf300722 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:44.511353 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:44.533242 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790579b-4442-452e-9e7c-6220acd37c1c None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:44.562147 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce993d1-cbf0-4b11-b274-8496bf300722 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:44.585254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c94f49-1c35-4e9c-95ed-cbad273da9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:44.586548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c94f49-1c35-4e9c-95ed-cbad273da9ca None admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:44.587066 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c94f49-1c35-4e9c-95ed-cbad273da9ca None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:44.587856 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c94f49-1c35-4e9c-95ed-cbad273da9ca None admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:44.589549 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c94f49-1c35-4e9c-95ed-cbad273da9ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:44.591831 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:44.593360 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c94f49-1c35-4e9c-95ed-cbad273da9ca None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:44.601348 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907fc67-ab06-46cb-9ebf-7f3e4ca4aa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:44.602026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907fc67-ab06-46cb-9ebf-7f3e4ca4aa30 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:44.602317 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907fc67-ab06-46cb-9ebf-7f3e4ca4aa30 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:44.602600 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907fc67-ab06-46cb-9ebf-7f3e4ca4aa30 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:44.603363 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907fc67-ab06-46cb-9ebf-7f3e4ca4aa30 None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:44.603678 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907fc67-ab06-46cb-9ebf-7f3e4ca4aa30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:44.605116 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907fc67-ab06-46cb-9ebf-7f3e4ca4aa30 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:44.619944 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 112/215] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:44.623045 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907fc67-ab06-46cb-9ebf-7f3e4ca4aa30 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:44.627922 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 104/216] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 14 11:47:44 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:47:44.754722 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907fc67-ab06-46cb-9ebf-7f3e4ca4aa30 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:44.797223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8399ab-5b5b-444e-a1b5-e0e3b30dde44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:44.798514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8399ab-5b5b-444e-a1b5-e0e3b30dde44 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:44.799007 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8399ab-5b5b-444e-a1b5-e0e3b30dde44 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:44.799484 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8399ab-5b5b-444e-a1b5-e0e3b30dde44 None admin] PATH_INFO: `/v3/users/58c71ab6f6c14e4282cbda82b2bce99d` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:44.815564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8399ab-5b5b-444e-a1b5-e0e3b30dde44 None admin] RBAC: Authorizing `identity:get_user(user_id=58c71ab6f6c14e4282cbda82b2bce99d)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:44.818256 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8399ab-5b5b-444e-a1b5-e0e3b30dde44 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:44.820598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 113/217] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:44 2022] GET /identity/v3/users/58c71ab6f6c14e4282cbda82b2bce99d => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:44.826236 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c94f49-1c35-4e9c-95ed-cbad273da9ca None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:44.944267 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c94f49-1c35-4e9c-95ed-cbad273da9ca None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:44.981482 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c609264-96fa-4498-ac3a-d9e310db86f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:44.982516 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c609264-96fa-4498-ac3a-d9e310db86f6 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:44.983003 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c609264-96fa-4498-ac3a-d9e310db86f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:44.983478 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c609264-96fa-4498-ac3a-d9e310db86f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:44.997341 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:45.074650 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c609264-96fa-4498-ac3a-d9e310db86f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:45.077050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c609264-96fa-4498-ac3a-d9e310db86f6 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:45.197766 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 105/218] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:45.205026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8399ab-5b5b-444e-a1b5-e0e3b30dde44 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:45.259537 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf5348-4e95-4e99-947e-34a7d307c2d5 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:45.260212 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf5348-4e95-4e99-947e-34a7d307c2d5 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:45.260694 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf5348-4e95-4e99-947e-34a7d307c2d5 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:45.262559 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 106/219] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:47:45.269945 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c057d-7a68-47cd-88f7-d2140c6d3f6a None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:45.270526 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c057d-7a68-47cd-88f7-d2140c6d3f6a None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:45.271045 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c057d-7a68-47cd-88f7-d2140c6d3f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:45.291882 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-140c057d-7a68-47cd-88f7-d2140c6d3f6a None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:45.293445 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-140c057d-7a68-47cd-88f7-d2140c6d3f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:45.328791 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:45.348413 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:45.386941 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 107/220] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:45.392823 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6def30-33da-48ed-b396-93a74f40acf0 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:45.393394 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6def30-33da-48ed-b396-93a74f40acf0 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:45.394395 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6def30-33da-48ed-b396-93a74f40acf0 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:45.396774 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 108/221] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:45.406152 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ed99-e80e-4d44-b087-cc2f8d86d186 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:45.406975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ed99-e80e-4d44-b087-cc2f8d86d186 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:45.407475 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ed99-e80e-4d44-b087-cc2f8d86d186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:45.424815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8399ab-5b5b-444e-a1b5-e0e3b30dde44 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:45.429013 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-9b17ed99-e80e-4d44-b087-cc2f8d86d186 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:45.430437 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-9b17ed99-e80e-4d44-b087-cc2f8d86d186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:45.462599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498bfe4-787f-41d6-86a8-aa907c2cc4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:45.463509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498bfe4-787f-41d6-86a8-aa907c2cc4ec None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:45.463791 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498bfe4-787f-41d6-86a8-aa907c2cc4ec None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:45.464109 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498bfe4-787f-41d6-86a8-aa907c2cc4ec None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:45.465609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498bfe4-787f-41d6-86a8-aa907c2cc4ec None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:45.466990 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498bfe4-787f-41d6-86a8-aa907c2cc4ec None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:45.469296 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 114/222] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:45 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:45.472408 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498bfe4-787f-41d6-86a8-aa907c2cc4ec None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:45.529602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 109/223] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:45.530862 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ed99-e80e-4d44-b087-cc2f8d86d186 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:45.613270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498bfe4-787f-41d6-86a8-aa907c2cc4ec None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:45.632566 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:45.654323 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43115fd6-ac40-4bc7-a090-2a01bc238677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:45.655574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43115fd6-ac40-4bc7-a090-2a01bc238677 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:45.656079 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43115fd6-ac40-4bc7-a090-2a01bc238677 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:45.656544 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43115fd6-ac40-4bc7-a090-2a01bc238677 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:45.668761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43115fd6-ac40-4bc7-a090-2a01bc238677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-43115fd6-ac40-4bc7-a090-2a01bc238677 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:45.677589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:45.678444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:45.679215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:45.679215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:45.679215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:45.679215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:45.679215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:45.679215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:45.679215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:45.679215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:45.679215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:45.679215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:45.679215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:45.679215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:45.681693 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 115/224] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:47:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:45.682131 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:45.682979 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43115fd6-ac40-4bc7-a090-2a01bc238677 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:45.686184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ed99-e80e-4d44-b087-cc2f8d86d186 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:45.726480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31994c53-23aa-4ea7-8e23-10b52f9af7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:45.727511 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31994c53-23aa-4ea7-8e23-10b52f9af7a8 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:45.728034 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31994c53-23aa-4ea7-8e23-10b52f9af7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:45.728546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31994c53-23aa-4ea7-8e23-10b52f9af7a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:45.729584 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31994c53-23aa-4ea7-8e23-10b52f9af7a8 None admin] RBAC: Adding query filter params (role.id=7b517960be1c437d850537c7e0aa985a, scope.project.id=3bab82494d694b8db2b6698451bdf404, user.id=58c71ab6f6c14e4282cbda82b2bce99d) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:45.730089 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31994c53-23aa-4ea7-8e23-10b52f9af7a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:45.731737 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31994c53-23aa-4ea7-8e23-10b52f9af7a8 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:45.738918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 110/225] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:45 2022] GET /identity/v3/role_assignments?user.id=58c71ab6f6c14e4282cbda82b2bce99d&scope.project.id=3bab82494d694b8db2b6698451bdf404&role.id=7b517960be1c437d850537c7e0aa985a => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:45.740407 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31994c53-23aa-4ea7-8e23-10b52f9af7a8 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:45.828213 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43115fd6-ac40-4bc7-a090-2a01bc238677 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:45.870311 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3015932-1b26-4fa8-9a4c-f4dce2a8dc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:45.872177 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3015932-1b26-4fa8-9a4c-f4dce2a8dc38 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:45.872666 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3015932-1b26-4fa8-9a4c-f4dce2a8dc38 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:45.873169 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3015932-1b26-4fa8-9a4c-f4dce2a8dc38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:45.887640 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3015932-1b26-4fa8-9a4c-f4dce2a8dc38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-d3015932-1b26-4fa8-9a4c-f4dce2a8dc38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:45.897974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:45.898929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:45.899674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:45.899674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:45.899674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:45.899674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:45.899674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:45.899674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:45.899674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:45.899674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:45.899674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:45.899674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:45.899674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:47:45.899674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:45.902860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 116/226] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:47:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:45.908948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3015932-1b26-4fa8-9a4c-f4dce2a8dc38 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:45.980200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:46.016769 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31994c53-23aa-4ea7-8e23-10b52f9af7a8 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:46.064249 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e083f7-8ebc-4bc7-ba56-262722ede7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:46.065335 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e083f7-8ebc-4bc7-ba56-262722ede7f3 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:46.066975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e083f7-8ebc-4bc7-ba56-262722ede7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:46.067492 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e083f7-8ebc-4bc7-ba56-262722ede7f3 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:46.068475 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e083f7-8ebc-4bc7-ba56-262722ede7f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:46.068989 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e083f7-8ebc-4bc7-ba56-262722ede7f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:46.070573 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e083f7-8ebc-4bc7-ba56-262722ede7f3 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:46.078490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3015932-1b26-4fa8-9a4c-f4dce2a8dc38 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:46.088077 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 111/227] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:46.093502 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e083f7-8ebc-4bc7-ba56-262722ede7f3 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:46.156250 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:46.156588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea280160-3045-428f-8eb5-8ee1e7bb86a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:46.157607 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280160-3045-428f-8eb5-8ee1e7bb86a2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:46.158166 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280160-3045-428f-8eb5-8ee1e7bb86a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:46.158711 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280160-3045-428f-8eb5-8ee1e7bb86a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:46.160378 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea280160-3045-428f-8eb5-8ee1e7bb86a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:46.161202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea280160-3045-428f-8eb5-8ee1e7bb86a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:46.162768 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea280160-3045-428f-8eb5-8ee1e7bb86a2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:46.173525 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 117/228] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:47:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:46.184946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea280160-3045-428f-8eb5-8ee1e7bb86a2 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:46.272178 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e083f7-8ebc-4bc7-ba56-262722ede7f3 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:46.312791 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3171ee-2add-4865-a020-922ced7f06b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:46.314224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3171ee-2add-4865-a020-922ced7f06b6 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:46.314741 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3171ee-2add-4865-a020-922ced7f06b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:46.315870 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3171ee-2add-4865-a020-922ced7f06b6 None admin] PATH_INFO: `/v3/users/e702a6132d68479fa19d935c4c4bbf5d` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:46.317721 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3171ee-2add-4865-a020-922ced7f06b6 None admin] RBAC: Authorizing `identity:get_user(user_id=e702a6132d68479fa19d935c4c4bbf5d)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:46.319407 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3171ee-2add-4865-a020-922ced7f06b6 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:46.321355 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 112/229] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:46 2022] GET /identity/v3/users/e702a6132d68479fa19d935c4c4bbf5d => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:46.329830 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3171ee-2add-4865-a020-922ced7f06b6 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:46.444820 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:46.452660 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3171ee-2add-4865-a020-922ced7f06b6 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:46.455090 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:46.463622 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea280160-3045-428f-8eb5-8ee1e7bb86a2 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:46.493297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd884e7-a713-4fb1-b20f-1b5f9cb34051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:46.494523 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd884e7-a713-4fb1-b20f-1b5f9cb34051 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:46.495074 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd884e7-a713-4fb1-b20f-1b5f9cb34051 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:46.495553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd884e7-a713-4fb1-b20f-1b5f9cb34051 None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:46.497131 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd884e7-a713-4fb1-b20f-1b5f9cb34051 None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:46.498811 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd884e7-a713-4fb1-b20f-1b5f9cb34051 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:46.500771 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 113/230] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:46 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:46.513142 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd884e7-a713-4fb1-b20f-1b5f9cb34051 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:46.543130 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ba743-700c-4483-82d6-eb2c93171631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:46.545741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ba743-700c-4483-82d6-eb2c93171631 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:46.547286 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ba743-700c-4483-82d6-eb2c93171631 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:46.548233 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ba743-700c-4483-82d6-eb2c93171631 None admin] PATH_INFO: `/v3/users/e702a6132d68479fa19d935c4c4bbf5d` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:46.550968 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ba743-700c-4483-82d6-eb2c93171631 None admin] RBAC: Authorizing `identity:get_user(user_id=e702a6132d68479fa19d935c4c4bbf5d)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:46.553658 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ba743-700c-4483-82d6-eb2c93171631 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:46.560039 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 118/231] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:46 2022] GET /identity/v3/users/e702a6132d68479fa19d935c4c4bbf5d => generated 283 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:46.566004 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ba743-700c-4483-82d6-eb2c93171631 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:46.642780 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd884e7-a713-4fb1-b20f-1b5f9cb34051 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:46.685773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788de72-63d2-4edc-b3f6-488497e1dc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:46.686718 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788de72-63d2-4edc-b3f6-488497e1dc73 None admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:46.687056 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788de72-63d2-4edc-b3f6-488497e1dc73 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:46.687348 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788de72-63d2-4edc-b3f6-488497e1dc73 None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404/users/e702a6132d68479fa19d935c4c4bbf5d/roles/321ee52ce1bc4eafa201f23f55f23d2b` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:46.691805 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788de72-63d2-4edc-b3f6-488497e1dc73 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bab82494d694b8db2b6698451bdf404, user_id=e702a6132d68479fa19d935c4c4bbf5d, role_id=321ee52ce1bc4eafa201f23f55f23d2b)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:46.693360 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788de72-63d2-4edc-b3f6-488497e1dc73 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:46.731114 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 114/232] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:47:46 2022] PUT /identity/v3/projects/3bab82494d694b8db2b6698451bdf404/users/e702a6132d68479fa19d935c4c4bbf5d/roles/321ee52ce1bc4eafa201f23f55f23d2b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:47:46.796043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ba743-700c-4483-82d6-eb2c93171631 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:46.835019 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bdd8e-bceb-4481-8354-6e1e812abe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:46.836080 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bdd8e-bceb-4481-8354-6e1e812abe34 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:46.836372 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bdd8e-bceb-4481-8354-6e1e812abe34 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:46.836657 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bdd8e-bceb-4481-8354-6e1e812abe34 None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:46.837907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bdd8e-bceb-4481-8354-6e1e812abe34 None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:46.839491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bdd8e-bceb-4481-8354-6e1e812abe34 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:46.841683 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 119/233] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:46 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:46.848206 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788de72-63d2-4edc-b3f6-488497e1dc73 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:46.881214 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:46.969561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788de72-63d2-4edc-b3f6-488497e1dc73 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:47.010155 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2c57c-9a3f-4206-a062-e61100b35d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:47.011074 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2c57c-9a3f-4206-a062-e61100b35d1f None admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:47.011423 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2c57c-9a3f-4206-a062-e61100b35d1f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:47.011723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2c57c-9a3f-4206-a062-e61100b35d1f None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404/users/e702a6132d68479fa19d935c4c4bbf5d/roles/703199a2f03143128fbac7cc8481b912` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:47.014540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2c57c-9a3f-4206-a062-e61100b35d1f None admin] RBAC: Authorizing `identity:create_grant(project_id=3bab82494d694b8db2b6698451bdf404, user_id=e702a6132d68479fa19d935c4c4bbf5d, role_id=703199a2f03143128fbac7cc8481b912)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:47.016109 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2c57c-9a3f-4206-a062-e61100b35d1f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:47.038404 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 115/234] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:47:46 2022] PUT /identity/v3/projects/3bab82494d694b8db2b6698451bdf404/users/e702a6132d68479fa19d935c4c4bbf5d/roles/703199a2f03143128fbac7cc8481b912 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:47:47.403749 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7effd-3678-44eb-ab4a-7f422e17eff5 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:47.404161 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7effd-3678-44eb-ab4a-7f422e17eff5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:47.404357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7effd-3678-44eb-ab4a-7f422e17eff5 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:47.405993 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 120/235] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:47.412005 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6adbd-6c7d-4615-a97d-7764f23ce1a3 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:47.412445 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6adbd-6c7d-4615-a97d-7764f23ce1a3 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:47.412612 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6adbd-6c7d-4615-a97d-7764f23ce1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:47.437023 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-68f6adbd-6c7d-4615-a97d-7764f23ce1a3 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:47.438161 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-68f6adbd-6c7d-4615-a97d-7764f23ce1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:47.532363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 116/236] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:47.575826 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7effd-3678-44eb-ab4a-7f422e17eff5 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:47.620345 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:47.716294 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7effd-3678-44eb-ab4a-7f422e17eff5 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:47.721366 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffae9d4-beb6-4d66-a42c-107aaf54814a None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:47.721665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffae9d4-beb6-4d66-a42c-107aaf54814a None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:47.722084 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffae9d4-beb6-4d66-a42c-107aaf54814a None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:47.723821 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 117/237] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:47.756029 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3b0b8-50a6-4e28-b4f9-0ef9fab95d7b None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:47.756431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3b0b8-50a6-4e28-b4f9-0ef9fab95d7b None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:47.756731 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3b0b8-50a6-4e28-b4f9-0ef9fab95d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:47.769771 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2c8e5-c706-4398-bf8d-204f34a28fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:47.775612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c8e5-c706-4398-bf8d-204f34a28fcb None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:47.775955 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c8e5-c706-4398-bf8d-204f34a28fcb None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:47.776248 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c8e5-c706-4398-bf8d-204f34a28fcb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:47.792975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-bcf3b0b8-50a6-4e28-b4f9-0ef9fab95d7b None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:47.793153 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2c8e5-c706-4398-bf8d-204f34a28fcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:47.794588 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-bcf3b0b8-50a6-4e28-b4f9-0ef9fab95d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-3be2c8e5-c706-4398-bf8d-204f34a28fcb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:47.802999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:47.803867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:47.804654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:47.804654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:47.804654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:47.804654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:47.804654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:47.804654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:47.804654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:47.804654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:47.804654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:47.804654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:47.804654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:47.804654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:47.804654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 121/238] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:47.809258 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:47.810157 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2c8e5-c706-4398-bf8d-204f34a28fcb None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:47.934785 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 118/239] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:47.965400 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:47.973326 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2c8e5-c706-4398-bf8d-204f34a28fcb None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:47.978375 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3b0b8-50a6-4e28-b4f9-0ef9fab95d7b None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:48.075005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35789049-cffe-4f71-a3b7-c23737fbe1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:48.075524 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35789049-cffe-4f71-a3b7-c23737fbe1c9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:48.075810 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35789049-cffe-4f71-a3b7-c23737fbe1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:48.076124 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35789049-cffe-4f71-a3b7-c23737fbe1c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:48.076951 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35789049-cffe-4f71-a3b7-c23737fbe1c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:48.077262 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35789049-cffe-4f71-a3b7-c23737fbe1c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:48.078670 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35789049-cffe-4f71-a3b7-c23737fbe1c9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:48.099343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 122/240] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:48.100850 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3b0b8-50a6-4e28-b4f9-0ef9fab95d7b None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:48.107402 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35789049-cffe-4f71-a3b7-c23737fbe1c9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:48.144688 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393782a-6283-43ad-8350-2e71390347f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:48.145556 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393782a-6283-43ad-8350-2e71390347f3 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:48.145842 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393782a-6283-43ad-8350-2e71390347f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:48.146123 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393782a-6283-43ad-8350-2e71390347f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:48.147373 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393782a-6283-43ad-8350-2e71390347f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:48.148922 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393782a-6283-43ad-8350-2e71390347f3 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:48.150843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 119/241] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:48.156369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393782a-6283-43ad-8350-2e71390347f3 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:48.172717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:48.281603 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393782a-6283-43ad-8350-2e71390347f3 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:48.319295 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0e40f-8c24-4c32-a749-ac05755bcd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:48.320528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0e40f-8c24-4c32-a749-ac05755bcd16 None admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:48.321113 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0e40f-8c24-4c32-a749-ac05755bcd16 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:48.321590 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0e40f-8c24-4c32-a749-ac05755bcd16 None admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:48.322509 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0e40f-8c24-4c32-a749-ac05755bcd16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:48.324325 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0e40f-8c24-4c32-a749-ac05755bcd16 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:48.326686 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35789049-cffe-4f71-a3b7-c23737fbe1c9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:48.356225 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 120/242] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 14 11:47:48 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:47:48.397812 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2f6ba-8aab-4050-95c6-e835d74ee042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:48.398710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2f6ba-8aab-4050-95c6-e835d74ee042 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:48.398995 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2f6ba-8aab-4050-95c6-e835d74ee042 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:48.399324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2f6ba-8aab-4050-95c6-e835d74ee042 None admin] PATH_INFO: `/v3/users/8361df619bd7409aa8bf4e3703084e07` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:48.420266 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2f6ba-8aab-4050-95c6-e835d74ee042 None admin] RBAC: Authorizing `identity:get_user(user_id=8361df619bd7409aa8bf4e3703084e07)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:48.421785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2f6ba-8aab-4050-95c6-e835d74ee042 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:48.423922 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 123/243] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:48 2022] GET /identity/v3/users/8361df619bd7409aa8bf4e3703084e07 => generated 297 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:48.430434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0e40f-8c24-4c32-a749-ac05755bcd16 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:48.516753 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:48.522133 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e23d10-d457-493d-8fa8-908caa3ff825 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:48.522424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e23d10-d457-493d-8fa8-908caa3ff825 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:48.522695 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e23d10-d457-493d-8fa8-908caa3ff825 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:48.524416 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 124/244] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:48.530160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386f76a-3994-48dd-a498-1b2f3fa2c70c None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:48.530456 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386f76a-3994-48dd-a498-1b2f3fa2c70c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:48.530726 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386f76a-3994-48dd-a498-1b2f3fa2c70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:48.561513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-1386f76a-3994-48dd-a498-1b2f3fa2c70c None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:48.562681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1386f76a-3994-48dd-a498-1b2f3fa2c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:48.575308 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:48.605572 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0e40f-8c24-4c32-a749-ac05755bcd16 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:48.648175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c0ef-7c82-4f03-84e6-d46d29e2caec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:48.648835 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c0ef-7c82-4f03-84e6-d46d29e2caec None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:48.649120 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c0ef-7c82-4f03-84e6-d46d29e2caec None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:48.649395 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c0ef-7c82-4f03-84e6-d46d29e2caec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:48.654984 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 125/245] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:48.685935 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386f76a-3994-48dd-a498-1b2f3fa2c70c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:48.729381 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94c0ef-7c82-4f03-84e6-d46d29e2caec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:48.730858 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94c0ef-7c82-4f03-84e6-d46d29e2caec None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:48.814483 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:48.835844 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386f76a-3994-48dd-a498-1b2f3fa2c70c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:48.871245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 121/246] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:48.879031 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c0ef-7c82-4f03-84e6-d46d29e2caec None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:48.889896 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0d872-a193-461f-80be-d241a63cfb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:48.891044 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0d872-a193-461f-80be-d241a63cfb91 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:48.891536 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0d872-a193-461f-80be-d241a63cfb91 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:48.892123 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0d872-a193-461f-80be-d241a63cfb91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:48.904000 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0d872-a193-461f-80be-d241a63cfb91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-6bc0d872-a193-461f-80be-d241a63cfb91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:48.915015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:48.916242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:48.917043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:48.917043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:48.917043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:48.917043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:48.917043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:48.917043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:48.917043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:48.917043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:48.917043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:48.917043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:48.917043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:48.917043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:48.919778 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 126/247] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:48.928222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0d872-a193-461f-80be-d241a63cfb91 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:48.934514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:49.027860 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c0ef-7c82-4f03-84e6-d46d29e2caec None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:49.067712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384885b-9425-406b-8f54-f657eedf818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:49.069083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384885b-9425-406b-8f54-f657eedf818b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:49.070534 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384885b-9425-406b-8f54-f657eedf818b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:49.070534 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384885b-9425-406b-8f54-f657eedf818b None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:49.072057 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384885b-9425-406b-8f54-f657eedf818b None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:49.073962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384885b-9425-406b-8f54-f657eedf818b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:49.076904 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 122/248] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:48 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:49.077871 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0d872-a193-461f-80be-d241a63cfb91 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:49.085827 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384885b-9425-406b-8f54-f657eedf818b None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:49.121178 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ad69c-64bf-40e9-b9e9-426482015936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:49.122296 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ad69c-64bf-40e9-b9e9-426482015936 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:49.122776 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ad69c-64bf-40e9-b9e9-426482015936 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:49.123245 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ad69c-64bf-40e9-b9e9-426482015936 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:49.124347 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ad69c-64bf-40e9-b9e9-426482015936 None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:49.124950 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ad69c-64bf-40e9-b9e9-426482015936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:49.126650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ad69c-64bf-40e9-b9e9-426482015936 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:49.128166 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:49.137923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 127/249] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:49.144397 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ad69c-64bf-40e9-b9e9-426482015936 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:49.221952 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384885b-9425-406b-8f54-f657eedf818b None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:49.235640 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:49.263457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b9524-6e17-4d25-b8d4-8d69c7699813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:49.264244 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b9524-6e17-4d25-b8d4-8d69c7699813 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:49.264592 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b9524-6e17-4d25-b8d4-8d69c7699813 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:49.264955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b9524-6e17-4d25-b8d4-8d69c7699813 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:49.265858 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b9524-6e17-4d25-b8d4-8d69c7699813 None admin] RBAC: Adding query filter params (role.id=478bbce5a7b34a23aabf38a0d1789a54, scope.project.id=3bab82494d694b8db2b6698451bdf404, user.id=8361df619bd7409aa8bf4e3703084e07) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:49.266237 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b9524-6e17-4d25-b8d4-8d69c7699813 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:49.268630 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b9524-6e17-4d25-b8d4-8d69c7699813 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:49.275664 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 123/250] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:49 2022] GET /identity/v3/role_assignments?user.id=8361df619bd7409aa8bf4e3703084e07&scope.project.id=3bab82494d694b8db2b6698451bdf404&role.id=478bbce5a7b34a23aabf38a0d1789a54 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:49.281715 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ad69c-64bf-40e9-b9e9-426482015936 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:49.322806 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e839ad6-73fc-4fc9-a619-f4067b42dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:49.324165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e839ad6-73fc-4fc9-a619-f4067b42dc26 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:49.324655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e839ad6-73fc-4fc9-a619-f4067b42dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:49.325106 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e839ad6-73fc-4fc9-a619-f4067b42dc26 None admin] PATH_INFO: `/v3/users/58c71ab6f6c14e4282cbda82b2bce99d` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:49.326691 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e839ad6-73fc-4fc9-a619-f4067b42dc26 None admin] RBAC: Authorizing `identity:get_user(user_id=58c71ab6f6c14e4282cbda82b2bce99d)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:49.328434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e839ad6-73fc-4fc9-a619-f4067b42dc26 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:49.331244 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 128/251] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:49 2022] GET /identity/v3/users/58c71ab6f6c14e4282cbda82b2bce99d => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:49.336564 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b9524-6e17-4d25-b8d4-8d69c7699813 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:49.489901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:49.493786 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b9524-6e17-4d25-b8d4-8d69c7699813 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:49.531619 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca372553-1bc8-463f-9d75-2ec5b01b1ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:49.532517 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca372553-1bc8-463f-9d75-2ec5b01b1ac3 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:49.532802 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca372553-1bc8-463f-9d75-2ec5b01b1ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:49.533098 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca372553-1bc8-463f-9d75-2ec5b01b1ac3 None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:49.534997 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca372553-1bc8-463f-9d75-2ec5b01b1ac3 None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:49.536511 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca372553-1bc8-463f-9d75-2ec5b01b1ac3 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:49.538276 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 124/252] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:49 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:49.544462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e839ad6-73fc-4fc9-a619-f4067b42dc26 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:49.677032 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e839ad6-73fc-4fc9-a619-f4067b42dc26 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:49.721655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311339d-8a50-43cb-8e0f-0dc706ee51ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:49.723533 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311339d-8a50-43cb-8e0f-0dc706ee51ce None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:49.724064 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311339d-8a50-43cb-8e0f-0dc706ee51ce None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:49.724557 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311339d-8a50-43cb-8e0f-0dc706ee51ce None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404/users/58c71ab6f6c14e4282cbda82b2bce99d/roles/7b517960be1c437d850537c7e0aa985a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:49.726766 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311339d-8a50-43cb-8e0f-0dc706ee51ce None admin] RBAC: Authorizing `identity:create_grant(project_id=3bab82494d694b8db2b6698451bdf404, user_id=58c71ab6f6c14e4282cbda82b2bce99d, role_id=7b517960be1c437d850537c7e0aa985a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:49.728449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311339d-8a50-43cb-8e0f-0dc706ee51ce None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:49.732218 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:49.754880 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 129/253] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:47:49 2022] PUT /identity/v3/projects/3bab82494d694b8db2b6698451bdf404/users/58c71ab6f6c14e4282cbda82b2bce99d/roles/7b517960be1c437d850537c7e0aa985a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:47:49.855360 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11053c68-6e2d-4a1d-862b-0d288e771260 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:49.855709 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11053c68-6e2d-4a1d-862b-0d288e771260 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:49.855935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11053c68-6e2d-4a1d-862b-0d288e771260 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:49.857562 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 125/254] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:49.862963 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a316232-a18f-4f5a-bebe-af741925003e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:49.863567 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a316232-a18f-4f5a-bebe-af741925003e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:49.864119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a316232-a18f-4f5a-bebe-af741925003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:49.889083 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-5a316232-a18f-4f5a-bebe-af741925003e None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:49.890673 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-5a316232-a18f-4f5a-bebe-af741925003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:49.978389 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 130/255] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:50.014505 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11053c68-6e2d-4a1d-862b-0d288e771260 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:50.140290 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b1ca8-1114-4a93-9aac-1b41a0d1f56a None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:50.140742 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b1ca8-1114-4a93-9aac-1b41a0d1f56a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:50.140842 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b1ca8-1114-4a93-9aac-1b41a0d1f56a None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:50.142230 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 131/256] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:47:50.148078 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e052ed-234f-4f90-8908-43f07e62100a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:50.148481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e052ed-234f-4f90-8908-43f07e62100a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:50.148865 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e052ed-234f-4f90-8908-43f07e62100a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:50.151426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11053c68-6e2d-4a1d-862b-0d288e771260 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:50.171288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-f6e052ed-234f-4f90-8908-43f07e62100a None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:50.172846 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f6e052ed-234f-4f90-8908-43f07e62100a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:50.217003 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75073a65-ac36-4a62-83e7-483f8ca4af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:50.217819 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75073a65-ac36-4a62-83e7-483f8ca4af38 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:50.218106 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75073a65-ac36-4a62-83e7-483f8ca4af38 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:50.218387 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75073a65-ac36-4a62-83e7-483f8ca4af38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:50.243027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75073a65-ac36-4a62-83e7-483f8ca4af38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-75073a65-ac36-4a62-83e7-483f8ca4af38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:50.251265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:50.253495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:50.254297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:50.254297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:50.254297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:50.254297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:50.254297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:50.254297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:50.254297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:50.254297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:50.254297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:50.254297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:50.254297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:47:50.254297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:47:50.254297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 126/257] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:47:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:50.259519 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75073a65-ac36-4a62-83e7-483f8ca4af38 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:50.280877 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 132/258] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:50.311849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e052ed-234f-4f90-8908-43f07e62100a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:50.327697 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:50.384495 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:50.473926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75073a65-ac36-4a62-83e7-483f8ca4af38 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:50.476346 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e052ed-234f-4f90-8908-43f07e62100a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:50.543865 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e78ce-77cb-451e-9a4f-177acf96bfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:50.545482 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e78ce-77cb-451e-9a4f-177acf96bfcc None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:50.546439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e78ce-77cb-451e-9a4f-177acf96bfcc None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:50.548205 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e78ce-77cb-451e-9a4f-177acf96bfcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:50.549790 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd19b9-0ede-4fc2-983e-ec3db12d479e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:50.552579 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd19b9-0ede-4fc2-983e-ec3db12d479e None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:50.553075 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd19b9-0ede-4fc2-983e-ec3db12d479e None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:50.553629 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd19b9-0ede-4fc2-983e-ec3db12d479e None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:50.554735 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd19b9-0ede-4fc2-983e-ec3db12d479e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:50.556165 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd19b9-0ede-4fc2-983e-ec3db12d479e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:50.559874 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd19b9-0ede-4fc2-983e-ec3db12d479e None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:50.573298 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e78ce-77cb-451e-9a4f-177acf96bfcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:50.575809 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 127/259] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:47:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:50.582286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd19b9-0ede-4fc2-983e-ec3db12d479e None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-d81e78ce-77cb-451e-9a4f-177acf96bfcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:50.588643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:50.589514 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:50.590355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:50.590355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:50.590355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:50.590355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:50.590355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:50.590355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:50.590355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:50.590355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:50.590355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:50.590355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:50.590355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:47:50.590355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:50.600055 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 133/260] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:47:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:47:50.606954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e78ce-77cb-451e-9a4f-177acf96bfcc None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:50.785855 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e78ce-77cb-451e-9a4f-177acf96bfcc None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:50.808211 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:50.816168 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:50.827666 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611ccc1-008c-4d44-ac47-76c0b616516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:50.828681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611ccc1-008c-4d44-ac47-76c0b616516d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:50.829170 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611ccc1-008c-4d44-ac47-76c0b616516d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:50.829651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611ccc1-008c-4d44-ac47-76c0b616516d None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:50.831658 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611ccc1-008c-4d44-ac47-76c0b616516d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:50.833883 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611ccc1-008c-4d44-ac47-76c0b616516d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:50.835523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611ccc1-008c-4d44-ac47-76c0b616516d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:50.844898 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 134/261] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:50.850852 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611ccc1-008c-4d44-ac47-76c0b616516d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:50.853798 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd19b9-0ede-4fc2-983e-ec3db12d479e None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:50.940761 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690da68b-1066-402b-829d-a2f4f8688f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:50.941666 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690da68b-1066-402b-829d-a2f4f8688f5f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:50.941951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690da68b-1066-402b-829d-a2f4f8688f5f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:50.942230 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690da68b-1066-402b-829d-a2f4f8688f5f None admin] PATH_INFO: `/v3/users/e702a6132d68479fa19d935c4c4bbf5d` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:50.943535 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690da68b-1066-402b-829d-a2f4f8688f5f None admin] RBAC: Authorizing `identity:get_user(user_id=e702a6132d68479fa19d935c4c4bbf5d)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:50.945032 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690da68b-1066-402b-829d-a2f4f8688f5f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:50.946984 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 128/262] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:50 2022] GET /identity/v3/users/e702a6132d68479fa19d935c4c4bbf5d => generated 283 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:50.952327 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690da68b-1066-402b-829d-a2f4f8688f5f None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:50.961115 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611ccc1-008c-4d44-ac47-76c0b616516d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:51.017050 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891cad4-4140-4e9e-9e3c-66ae89462934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:51.019692 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891cad4-4140-4e9e-9e3c-66ae89462934 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:51.020243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891cad4-4140-4e9e-9e3c-66ae89462934 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:51.020728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891cad4-4140-4e9e-9e3c-66ae89462934 None admin] PATH_INFO: `/v3/users/e702a6132d68479fa19d935c4c4bbf5d` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:51.022170 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891cad4-4140-4e9e-9e3c-66ae89462934 None admin] RBAC: Authorizing `identity:get_user(user_id=e702a6132d68479fa19d935c4c4bbf5d)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:51.023825 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891cad4-4140-4e9e-9e3c-66ae89462934 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:51.026097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 135/263] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:50 2022] GET /identity/v3/users/e702a6132d68479fa19d935c4c4bbf5d => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:51.032249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891cad4-4140-4e9e-9e3c-66ae89462934 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:51.092876 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:51.135927 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690da68b-1066-402b-829d-a2f4f8688f5f None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:51.211982 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891cad4-4140-4e9e-9e3c-66ae89462934 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:51.225303 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfae4b-bf52-49ab-a727-dec07c4b4840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:51.225986 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfae4b-bf52-49ab-a727-dec07c4b4840 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:51.226280 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfae4b-bf52-49ab-a727-dec07c4b4840 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:51.226566 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfae4b-bf52-49ab-a727-dec07c4b4840 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:51.267551 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:51.269249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786231a4-b42b-4847-97ef-b77c29eb72b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:51.269630 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786231a4-b42b-4847-97ef-b77c29eb72b8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:51.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786231a4-b42b-4847-97ef-b77c29eb72b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:51.270211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786231a4-b42b-4847-97ef-b77c29eb72b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:51.318100 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edfae4b-bf52-49ab-a727-dec07c4b4840 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:51.319981 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edfae4b-bf52-49ab-a727-dec07c4b4840 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:51.414520 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786231a4-b42b-4847-97ef-b77c29eb72b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:51.415860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786231a4-b42b-4847-97ef-b77c29eb72b8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:51.428990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 129/264] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:51.434624 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfae4b-bf52-49ab-a727-dec07c4b4840 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:51.505965 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:51.507716 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:51.557157 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfae4b-bf52-49ab-a727-dec07c4b4840 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:51.609226 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289c254-4ecc-4beb-96e5-d6128c3719ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:51.610484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289c254-4ecc-4beb-96e5-d6128c3719ce None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:51.610978 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 136/265] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:51.611192 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289c254-4ecc-4beb-96e5-d6128c3719ce None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:51.611670 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289c254-4ecc-4beb-96e5-d6128c3719ce None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:51.613522 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289c254-4ecc-4beb-96e5-d6128c3719ce None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:51.615201 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289c254-4ecc-4beb-96e5-d6128c3719ce None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:51.616790 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786231a4-b42b-4847-97ef-b77c29eb72b8 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:51.617397 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 130/266] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:51 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:51.623107 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289c254-4ecc-4beb-96e5-d6128c3719ce None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:51.740745 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289c254-4ecc-4beb-96e5-d6128c3719ce None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:51.767205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:51.780699 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe11a14-d657-4b9c-854e-e18d79064dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:51.781704 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe11a14-d657-4b9c-854e-e18d79064dc3 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:51.782231 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe11a14-d657-4b9c-854e-e18d79064dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:51.782711 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe11a14-d657-4b9c-854e-e18d79064dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:51.783750 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe11a14-d657-4b9c-854e-e18d79064dc3 None admin] RBAC: Adding query filter params (role.id=703199a2f03143128fbac7cc8481b912, scope.project.id=3bab82494d694b8db2b6698451bdf404, user.id=e702a6132d68479fa19d935c4c4bbf5d) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:51.785077 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe11a14-d657-4b9c-854e-e18d79064dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:51.787009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe11a14-d657-4b9c-854e-e18d79064dc3 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:51.794019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 131/267] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:51 2022] GET /identity/v3/role_assignments?user.id=e702a6132d68479fa19d935c4c4bbf5d&scope.project.id=3bab82494d694b8db2b6698451bdf404&role.id=703199a2f03143128fbac7cc8481b912 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:51.822306 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786231a4-b42b-4847-97ef-b77c29eb72b8 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:51.871877 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571eb98-def5-4433-adf9-d5b60bc47d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:51.872837 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571eb98-def5-4433-adf9-d5b60bc47d65 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:51.873127 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571eb98-def5-4433-adf9-d5b60bc47d65 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:51.873411 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571eb98-def5-4433-adf9-d5b60bc47d65 None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:51.874820 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571eb98-def5-4433-adf9-d5b60bc47d65 None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:51.876464 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571eb98-def5-4433-adf9-d5b60bc47d65 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:51.878854 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 137/268] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:51 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:51.885970 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe11a14-d657-4b9c-854e-e18d79064dc3 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:52.031213 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe11a14-d657-4b9c-854e-e18d79064dc3 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:52.070805 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fab14-996f-427b-8a02-89e867ff7974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:52.071483 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fab14-996f-427b-8a02-89e867ff7974 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:52.071773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fab14-996f-427b-8a02-89e867ff7974 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:52.072096 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fab14-996f-427b-8a02-89e867ff7974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:52.072945 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fab14-996f-427b-8a02-89e867ff7974 None admin] RBAC: Adding query filter params (role.id=321ee52ce1bc4eafa201f23f55f23d2b, scope.project.id=3bab82494d694b8db2b6698451bdf404, user.id=e702a6132d68479fa19d935c4c4bbf5d) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:52.073267 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fab14-996f-427b-8a02-89e867ff7974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:52.074762 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fab14-996f-427b-8a02-89e867ff7974 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:52.082485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 132/269] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:51 2022] GET /identity/v3/role_assignments?user.id=e702a6132d68479fa19d935c4c4bbf5d&scope.project.id=3bab82494d694b8db2b6698451bdf404&role.id=321ee52ce1bc4eafa201f23f55f23d2b => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:52.618568 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8205d-694d-4597-9284-5894d09ea845 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:52.619130 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8205d-694d-4597-9284-5894d09ea845 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:52.619477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8205d-694d-4597-9284-5894d09ea845 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:52.621312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 138/270] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:52.626481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c1333-cbae-4622-8aae-2f9e96874e51 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:52.626950 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c1333-cbae-4622-8aae-2f9e96874e51 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:52.627023 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c1333-cbae-4622-8aae-2f9e96874e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:52.646530 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-e27c1333-cbae-4622-8aae-2f9e96874e51 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:52.647728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-e27c1333-cbae-4622-8aae-2f9e96874e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:52.666779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc95b7-da40-472b-b7a6-640de66a2bcd None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:52.667084 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc95b7-da40-472b-b7a6-640de66a2bcd None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:52.667345 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc95b7-da40-472b-b7a6-640de66a2bcd None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:52.668881 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 139/271] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:52.675848 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29764a45-4fbf-494f-8432-73a1e87d3db2 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:52.676187 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29764a45-4fbf-494f-8432-73a1e87d3db2 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:52.677057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29764a45-4fbf-494f-8432-73a1e87d3db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:52.700899 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-29764a45-4fbf-494f-8432-73a1e87d3db2 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:52.702102 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-29764a45-4fbf-494f-8432-73a1e87d3db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:52.706477 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:52.712382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:52.744016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 133/272] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:52.745484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9c40d-2d08-4f53-9cba-f2c9f491a1cb None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:52.745779 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9c40d-2d08-4f53-9cba-f2c9f491a1cb None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:52.746059 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9c40d-2d08-4f53-9cba-f2c9f491a1cb None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:52.747347 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 134/273] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:52.753134 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4578c9-16fe-49bc-843f-37233115bfcb None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:52.753582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4578c9-16fe-49bc-843f-37233115bfcb None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:52.753971 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4578c9-16fe-49bc-843f-37233115bfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:52.776232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-0d4578c9-16fe-49bc-843f-37233115bfcb None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:52.777511 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-0d4578c9-16fe-49bc-843f-37233115bfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:52.803953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 140/274] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:52.803953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29764a45-4fbf-494f-8432-73a1e87d3db2 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:52.864063 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 135/275] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:52.864771 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4578c9-16fe-49bc-843f-37233115bfcb None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:52.931281 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29764a45-4fbf-494f-8432-73a1e87d3db2 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:52.968018 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d82aa3-0ff5-45b7-aa78-fa07d695c7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:52.968942 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d82aa3-0ff5-45b7-aa78-fa07d695c7f9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:52.969513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d82aa3-0ff5-45b7-aa78-fa07d695c7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:52.969800 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d82aa3-0ff5-45b7-aa78-fa07d695c7f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:52.981735 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d82aa3-0ff5-45b7-aa78-fa07d695c7f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:52.986751 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4578c9-16fe-49bc-843f-37233115bfcb None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-90d82aa3-0ff5-45b7-aa78-fa07d695c7f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:52.990199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:52.991027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:52.991801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:52.991801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:52.991801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:52.991801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:52.991801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:52.991801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:52.991801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:52.991801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:52.991801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:52.991801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:52.991801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:52.991801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:52.996266 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 141/276] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:52.996988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d82aa3-0ff5-45b7-aa78-fa07d695c7f9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:52.999837 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:53.004843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:53.027672 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ded03-88ed-4cc3-89f6-b6929aa80130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:53.028507 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ded03-88ed-4cc3-89f6-b6929aa80130 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:53.028794 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ded03-88ed-4cc3-89f6-b6929aa80130 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:53.029239 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ded03-88ed-4cc3-89f6-b6929aa80130 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:53.030244 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ded03-88ed-4cc3-89f6-b6929aa80130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:53.031684 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ded03-88ed-4cc3-89f6-b6929aa80130 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:53.038574 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 136/277] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:53.038574 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ded03-88ed-4cc3-89f6-b6929aa80130 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:53.110316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d82aa3-0ff5-45b7-aa78-fa07d695c7f9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:53.147472 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda3fd3-63b9-4513-a977-981071207bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:53.148355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda3fd3-63b9-4513-a977-981071207bc2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:53.148647 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda3fd3-63b9-4513-a977-981071207bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:53.148930 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda3fd3-63b9-4513-a977-981071207bc2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:53.153456 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ded03-88ed-4cc3-89f6-b6929aa80130 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:53.161304 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda3fd3-63b9-4513-a977-981071207bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-fdda3fd3-63b9-4513-a977-981071207bc2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:53.169590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:53.170549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:53.171334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:53.171334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:53.171334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:53.171334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:53.171334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:53.171334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:53.171334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:53.171334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:53.171334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:53.171334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:53.171334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:53.171334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:53.175969 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 142/278] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:53.179087 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda3fd3-63b9-4513-a977-981071207bc2 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:53.201648 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5225-72a4-4ce2-afa0-19c9b8855c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:53.202245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5225-72a4-4ce2-afa0-19c9b8855c99 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:53.202533 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5225-72a4-4ce2-afa0-19c9b8855c99 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:53.202814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5225-72a4-4ce2-afa0-19c9b8855c99 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:53.203563 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b5225-72a4-4ce2-afa0-19c9b8855c99 None admin] RBAC: Adding query filter params (name=member) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:53.203875 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b5225-72a4-4ce2-afa0-19c9b8855c99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:53.205287 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b5225-72a4-4ce2-afa0-19c9b8855c99 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:53.219148 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 137/279] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:53.219148 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5225-72a4-4ce2-afa0-19c9b8855c99 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:53.252197 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:53.268595 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:53.299724 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda3fd3-63b9-4513-a977-981071207bc2 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:53.331027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5225-72a4-4ce2-afa0-19c9b8855c99 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:53.337425 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6d19e-21d4-4693-9c9a-da7a82670c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:53.338099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d19e-21d4-4693-9c9a-da7a82670c31 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:53.338386 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d19e-21d4-4693-9c9a-da7a82670c31 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:53.338671 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d19e-21d4-4693-9c9a-da7a82670c31 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:53.339404 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6d19e-21d4-4693-9c9a-da7a82670c31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:53.340883 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6d19e-21d4-4693-9c9a-da7a82670c31 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:53.361309 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 143/280] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 14 11:47:53 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:47:53.362247 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6d19e-21d4-4693-9c9a-da7a82670c31 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:53.368280 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f462878-d77b-414e-8295-1d68c6c95870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:53.368966 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f462878-d77b-414e-8295-1d68c6c95870 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:53.369252 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f462878-d77b-414e-8295-1d68c6c95870 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:53.369531 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f462878-d77b-414e-8295-1d68c6c95870 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:53.370297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f462878-d77b-414e-8295-1d68c6c95870 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:53.370608 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f462878-d77b-414e-8295-1d68c6c95870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:53.372062 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f462878-d77b-414e-8295-1d68c6c95870 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:53.386907 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 138/281] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:53.386907 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f1712-a7d4-4b0b-896b-13e32a1643bd None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:53.386907 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f1712-a7d4-4b0b-896b-13e32a1643bd None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:53.386907 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f1712-a7d4-4b0b-896b-13e32a1643bd None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:53.386907 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 139/282] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:53.388894 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f1712-a7d4-4b0b-896b-13e32a1643bd None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:53.504305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6d19e-21d4-4693-9c9a-da7a82670c31 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:53.513228 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f1712-a7d4-4b0b-896b-13e32a1643bd None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:53.516904 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:53.527003 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:53.551812 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ded4c-bb8a-4187-b3a1-08fdec811d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:53.552796 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ded4c-bb8a-4187-b3a1-08fdec811d18 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:53.553209 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ded4c-bb8a-4187-b3a1-08fdec811d18 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:53.553499 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ded4c-bb8a-4187-b3a1-08fdec811d18 None admin] PATH_INFO: `/v3/users/4f51381eca5d4595b6544560a402b653` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:53.556375 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34999710-9787-40c2-8f3c-8fedc435689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:53.557002 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34999710-9787-40c2-8f3c-8fedc435689b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:53.557289 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34999710-9787-40c2-8f3c-8fedc435689b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:53.557565 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34999710-9787-40c2-8f3c-8fedc435689b None admin] PATH_INFO: `/v3/users/8361df619bd7409aa8bf4e3703084e07` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:53.558971 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34999710-9787-40c2-8f3c-8fedc435689b None admin] RBAC: Authorizing `identity:get_user(user_id=8361df619bd7409aa8bf4e3703084e07)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:53.561417 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34999710-9787-40c2-8f3c-8fedc435689b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:53.562606 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 140/283] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:53 2022] GET /identity/v3/users/8361df619bd7409aa8bf4e3703084e07 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:53.563788 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1c18-bd23-4752-8e77-3168d10a5c37 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:53.564115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1c18-bd23-4752-8e77-3168d10a5c37 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:53.564402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1c18-bd23-4752-8e77-3168d10a5c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:53.569286 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ded4c-bb8a-4187-b3a1-08fdec811d18 None admin] RBAC: Authorizing `identity:get_user(user_id=4f51381eca5d4595b6544560a402b653)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:53.570770 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ded4c-bb8a-4187-b3a1-08fdec811d18 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:53.572692 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 144/284] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:53 2022] GET /identity/v3/users/4f51381eca5d4595b6544560a402b653 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:53.573338 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ded4c-bb8a-4187-b3a1-08fdec811d18 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:53.588125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-520c1c18-bd23-4752-8e77-3168d10a5c37 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:53.590126 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-520c1c18-bd23-4752-8e77-3168d10a5c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:53.668284 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 141/285] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:53.669909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c1c18-bd23-4752-8e77-3168d10a5c37 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:53.701822 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ded4c-bb8a-4187-b3a1-08fdec811d18 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:53.748580 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8669f8b-a1db-4193-98c6-1e4b39f01345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:53.749706 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8669f8b-a1db-4193-98c6-1e4b39f01345 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:53.749997 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8669f8b-a1db-4193-98c6-1e4b39f01345 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:53.750277 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8669f8b-a1db-4193-98c6-1e4b39f01345 None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:53.751643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8669f8b-a1db-4193-98c6-1e4b39f01345 None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:53.753698 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8669f8b-a1db-4193-98c6-1e4b39f01345 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:53.755460 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 145/286] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:53 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:53.763929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8669f8b-a1db-4193-98c6-1e4b39f01345 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:53.798579 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c1c18-bd23-4752-8e77-3168d10a5c37 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:53.800134 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:53.815038 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:53.838924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d648d4-6334-48c9-9a35-8844b9b1e6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:53.839592 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d648d4-6334-48c9-9a35-8844b9b1e6a2 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:53.839880 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d648d4-6334-48c9-9a35-8844b9b1e6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:53.840189 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d648d4-6334-48c9-9a35-8844b9b1e6a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:53.841026 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d648d4-6334-48c9-9a35-8844b9b1e6a2 None admin] RBAC: Adding query filter params (role.id=7b517960be1c437d850537c7e0aa985a, user.id=4f51381eca5d4595b6544560a402b653, scope.system=all) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:53.841450 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d648d4-6334-48c9-9a35-8844b9b1e6a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:53.843025 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d648d4-6334-48c9-9a35-8844b9b1e6a2 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:53.848952 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 142/287] 10.222.0.49 () {56 vars in 1308 bytes} [Thu Jul 14 11:47:53 2022] GET /identity/v3/role_assignments?user.id=4f51381eca5d4595b6544560a402b653&scope.system=all&role.id=7b517960be1c437d850537c7e0aa985a => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:53.849682 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d648d4-6334-48c9-9a35-8844b9b1e6a2 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:53.898993 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8669f8b-a1db-4193-98c6-1e4b39f01345 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:53.968764 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b306a54-99b3-4d4b-97bf-d4c40e4b8c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:53.969583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306a54-99b3-4d4b-97bf-d4c40e4b8c6d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:53.969872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306a54-99b3-4d4b-97bf-d4c40e4b8c6d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:53.970149 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306a54-99b3-4d4b-97bf-d4c40e4b8c6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:53.973855 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d648d4-6334-48c9-9a35-8844b9b1e6a2 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:53.989852 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b306a54-99b3-4d4b-97bf-d4c40e4b8c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-9b306a54-99b3-4d4b-97bf-d4c40e4b8c6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:54.007047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:54.007983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:54.008755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:54.008755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:54.008755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:54.008755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:54.008755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:54.008755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:54.008755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:54.008755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:54.008755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:54.008755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:54.008755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:54.008755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:54.008755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 146/288] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:54.016260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b306a54-99b3-4d4b-97bf-d4c40e4b8c6d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:54.017242 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83385a4c-0f39-446c-b9af-4fa7db9dc6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:54.018141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83385a4c-0f39-446c-b9af-4fa7db9dc6a8 None admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:54.018426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83385a4c-0f39-446c-b9af-4fa7db9dc6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:54.018704 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83385a4c-0f39-446c-b9af-4fa7db9dc6a8 None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404/users/8361df619bd7409aa8bf4e3703084e07/roles/478bbce5a7b34a23aabf38a0d1789a54` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:54.021691 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83385a4c-0f39-446c-b9af-4fa7db9dc6a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bab82494d694b8db2b6698451bdf404, user_id=8361df619bd7409aa8bf4e3703084e07, role_id=478bbce5a7b34a23aabf38a0d1789a54)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:54.023260 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83385a4c-0f39-446c-b9af-4fa7db9dc6a8 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:54.043159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 143/289] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:47:53 2022] PUT /identity/v3/projects/3bab82494d694b8db2b6698451bdf404/users/8361df619bd7409aa8bf4e3703084e07/roles/478bbce5a7b34a23aabf38a0d1789a54 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:47:54.169508 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b306a54-99b3-4d4b-97bf-d4c40e4b8c6d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:54.173228 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:54.264848 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2fa2f-6f1e-42c5-b429-13dbf2c9215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:54.265505 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2fa2f-6f1e-42c5-b429-13dbf2c9215e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:54.265797 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2fa2f-6f1e-42c5-b429-13dbf2c9215e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:54.266077 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2fa2f-6f1e-42c5-b429-13dbf2c9215e None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:54.266849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2fa2f-6f1e-42c5-b429-13dbf2c9215e None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:54.267166 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2fa2f-6f1e-42c5-b429-13dbf2c9215e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:54.268683 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2fa2f-6f1e-42c5-b429-13dbf2c9215e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:54.284066 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 147/290] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:54.291372 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83385a4c-0f39-446c-b9af-4fa7db9dc6a8 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:54.330147 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:54.420864 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83385a4c-0f39-446c-b9af-4fa7db9dc6a8 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:54.467449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea33a5-9422-43b1-ad43-e5cca826c518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:54.468725 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea33a5-9422-43b1-ad43-e5cca826c518 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:54.469210 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea33a5-9422-43b1-ad43-e5cca826c518 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:54.469686 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea33a5-9422-43b1-ad43-e5cca826c518 None admin] PATH_INFO: `/v3/users/58c71ab6f6c14e4282cbda82b2bce99d` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:54.476713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea33a5-9422-43b1-ad43-e5cca826c518 None admin] RBAC: Authorizing `identity:get_user(user_id=58c71ab6f6c14e4282cbda82b2bce99d)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:54.478431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea33a5-9422-43b1-ad43-e5cca826c518 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:54.480664 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 144/291] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:54 2022] GET /identity/v3/users/58c71ab6f6c14e4282cbda82b2bce99d => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:54.487177 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2fa2f-6f1e-42c5-b429-13dbf2c9215e None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:54.646524 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2fa2f-6f1e-42c5-b429-13dbf2c9215e None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:54.682423 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d3984-eba2-4aec-8ee9-814459f23067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:54.683088 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d3984-eba2-4aec-8ee9-814459f23067 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:54.683377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d3984-eba2-4aec-8ee9-814459f23067 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:54.683659 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d3984-eba2-4aec-8ee9-814459f23067 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:54.725971 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:54.757393 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d3984-eba2-4aec-8ee9-814459f23067 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:54.759441 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d3984-eba2-4aec-8ee9-814459f23067 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:54.869261 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 148/292] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:54.875170 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea33a5-9422-43b1-ad43-e5cca826c518 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:55.024712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:55.038111 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea33a5-9422-43b1-ad43-e5cca826c518 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:55.098966 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e240cc-5660-4ff4-9b60-b96dcb8866ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:55.099832 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e240cc-5660-4ff4-9b60-b96dcb8866ff None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:55.100152 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e240cc-5660-4ff4-9b60-b96dcb8866ff None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:55.100432 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e240cc-5660-4ff4-9b60-b96dcb8866ff None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:55.104620 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e240cc-5660-4ff4-9b60-b96dcb8866ff None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:55.106074 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e240cc-5660-4ff4-9b60-b96dcb8866ff None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:55.108183 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 145/293] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:54 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:55.113889 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d3984-eba2-4aec-8ee9-814459f23067 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:55.211965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:55.247738 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d3984-eba2-4aec-8ee9-814459f23067 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:55.281585 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b53847-13a9-427b-a61c-57d507ec9bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:55.282178 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53847-13a9-427b-a61c-57d507ec9bf6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:55.282466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53847-13a9-427b-a61c-57d507ec9bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:55.282749 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53847-13a9-427b-a61c-57d507ec9bf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:55.283581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b53847-13a9-427b-a61c-57d507ec9bf6 None admin] RBAC: Adding query filter params (role.id=7b517960be1c437d850537c7e0aa985a, scope.project.id=3bab82494d694b8db2b6698451bdf404, user.id=58c71ab6f6c14e4282cbda82b2bce99d) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:55.283918 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b53847-13a9-427b-a61c-57d507ec9bf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:55.285376 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b53847-13a9-427b-a61c-57d507ec9bf6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:55.291673 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 149/294] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:55 2022] GET /identity/v3/role_assignments?user.id=58c71ab6f6c14e4282cbda82b2bce99d&scope.project.id=3bab82494d694b8db2b6698451bdf404&role.id=7b517960be1c437d850537c7e0aa985a => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:56.178108 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b383a73-1f3d-4548-b240-2b8dd68d42e9 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:56.178486 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b383a73-1f3d-4548-b240-2b8dd68d42e9 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:56.178669 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b383a73-1f3d-4548-b240-2b8dd68d42e9 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:56.180116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 146/295] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:56.186198 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf32d4a-5d5f-4c29-b30c-fa8356f463e5 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:56.187049 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf32d4a-5d5f-4c29-b30c-fa8356f463e5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:56.187557 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf32d4a-5d5f-4c29-b30c-fa8356f463e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:56.206715 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-2cf32d4a-5d5f-4c29-b30c-fa8356f463e5 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:56.208277 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-2cf32d4a-5d5f-4c29-b30c-fa8356f463e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:56.211010 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab031a-34c5-4029-8e61-ce33caa4c726 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:56.211307 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab031a-34c5-4029-8e61-ce33caa4c726 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:56.211593 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab031a-34c5-4029-8e61-ce33caa4c726 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:56.214329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 147/296] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:56.219018 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d2ab-c2d5-4ee6-b9f5-564a14cff195 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:56.219313 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d2ab-c2d5-4ee6-b9f5-564a14cff195 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:56.219596 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d2ab-c2d5-4ee6-b9f5-564a14cff195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:56.238119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-acb3d2ab-c2d5-4ee6-b9f5-564a14cff195 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:56.239218 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-acb3d2ab-c2d5-4ee6-b9f5-564a14cff195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:56.298443 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 150/297] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:56.321319 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf32d4a-5d5f-4c29-b30c-fa8356f463e5 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:56.333443 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 148/298] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:56.358972 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3d2ab-c2d5-4ee6-b9f5-564a14cff195 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:56.388532 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:56.434728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf32d4a-5d5f-4c29-b30c-fa8356f463e5 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:56.456340 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:56.466202 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3d2ab-c2d5-4ee6-b9f5-564a14cff195 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:56.474835 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4431e5-2fdb-4d41-bc73-66bcf808d150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:56.476132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4431e5-2fdb-4d41-bc73-66bcf808d150 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:56.476569 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4431e5-2fdb-4d41-bc73-66bcf808d150 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:56.476994 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4431e5-2fdb-4d41-bc73-66bcf808d150 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:56.478604 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4431e5-2fdb-4d41-bc73-66bcf808d150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:56.480990 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4431e5-2fdb-4d41-bc73-66bcf808d150 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:56.483427 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 151/299] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:56.490126 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4431e5-2fdb-4d41-bc73-66bcf808d150 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:56.519567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a246822-c1e6-4530-be31-fb85a33776c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:56.520706 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a246822-c1e6-4530-be31-fb85a33776c1 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:56.521170 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a246822-c1e6-4530-be31-fb85a33776c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:56.521650 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a246822-c1e6-4530-be31-fb85a33776c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:56.537117 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a246822-c1e6-4530-be31-fb85a33776c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-2a246822-c1e6-4530-be31-fb85a33776c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:56.547992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:56.548896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:56.549651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:56.549651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:56.549651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:56.549651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:56.549651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:56.549651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:56.549651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:56.549651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:56.549651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:56.549651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:56.549651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:56.549651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:47:56.553114 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 149/300] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:56.559468 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a246822-c1e6-4530-be31-fb85a33776c1 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:56.617763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4431e5-2fdb-4d41-bc73-66bcf808d150 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:56.647598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:56.657581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e0b5d-8c6c-4c3f-acb5-d739d82f458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:56.658745 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e0b5d-8c6c-4c3f-acb5-d739d82f458b None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:56.658745 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e0b5d-8c6c-4c3f-acb5-d739d82f458b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:56.658944 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e0b5d-8c6c-4c3f-acb5-d739d82f458b None admin] PATH_INFO: `/v3/groups` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:56.659615 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e0b5d-8c6c-4c3f-acb5-d739d82f458b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:56.661507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e0b5d-8c6c-4c3f-acb5-d739d82f458b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:56.679754 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 152/301] 10.222.0.49 () {60 vars in 1134 bytes} [Thu Jul 14 11:47:56 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:47:56.681525 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e6094-ae7d-4874-9e7b-d90e38a5dd01 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:56.681825 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e6094-ae7d-4874-9e7b-d90e38a5dd01 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:56.682107 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e6094-ae7d-4874-9e7b-d90e38a5dd01 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:56.684482 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 153/302] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:56.690378 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dc617-5848-4506-9e26-9c3cafd60210 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:56.690676 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dc617-5848-4506-9e26-9c3cafd60210 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:56.690917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dc617-5848-4506-9e26-9c3cafd60210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:56.709227 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a246822-c1e6-4530-be31-fb85a33776c1 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:56.710727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0f4dc617-5848-4506-9e26-9c3cafd60210 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:56.712228 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0f4dc617-5848-4506-9e26-9c3cafd60210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:56.773525 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5a1ff-a7f1-4668-ab1a-d38adb5f5554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:56.775081 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5a1ff-a7f1-4668-ab1a-d38adb5f5554 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:56.775676 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5a1ff-a7f1-4668-ab1a-d38adb5f5554 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:56.776166 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5a1ff-a7f1-4668-ab1a-d38adb5f5554 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:56.778555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5a1ff-a7f1-4668-ab1a-d38adb5f5554 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:56.779701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5a1ff-a7f1-4668-ab1a-d38adb5f5554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:56.782150 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5a1ff-a7f1-4668-ab1a-d38adb5f5554 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:56.795869 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 150/303] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:56.801957 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5a1ff-a7f1-4668-ab1a-d38adb5f5554 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:56.809345 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 154/304] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:56.822108 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:56.834292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dc617-5848-4506-9e26-9c3cafd60210 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:56.939061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5a1ff-a7f1-4668-ab1a-d38adb5f5554 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:56.951500 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dc617-5848-4506-9e26-9c3cafd60210 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:56.971947 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:56.974666 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d72077-2481-454c-8cff-160c081e8b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:56.975546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d72077-2481-454c-8cff-160c081e8b1f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:56.975864 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d72077-2481-454c-8cff-160c081e8b1f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:56.976330 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d72077-2481-454c-8cff-160c081e8b1f None admin] PATH_INFO: `/v3/users/2878bd4ea618480aa6f4dad183d67f20` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:56.994429 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d72077-2481-454c-8cff-160c081e8b1f None admin] RBAC: Authorizing `identity:get_user(user_id=2878bd4ea618480aa6f4dad183d67f20)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:56.996785 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d72077-2481-454c-8cff-160c081e8b1f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:56.998066 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e2aa3-eb22-4fa8-a7aa-2df95717aab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:56.998627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 151/305] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:56 2022] GET /identity/v3/users/2878bd4ea618480aa6f4dad183d67f20 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:56.999714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427d424-0051-44a2-ae5f-ce64abc02553 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:57.000025 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427d424-0051-44a2-ae5f-ce64abc02553 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:57.000300 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427d424-0051-44a2-ae5f-ce64abc02553 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:57.001626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 152/306] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:57.003110 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e2aa3-eb22-4fa8-a7aa-2df95717aab1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:57.003420 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e2aa3-eb22-4fa8-a7aa-2df95717aab1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:57.003702 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e2aa3-eb22-4fa8-a7aa-2df95717aab1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:57.006190 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427d424-0051-44a2-ae5f-ce64abc02553 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:57.018813 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e2aa3-eb22-4fa8-a7aa-2df95717aab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-b42e2aa3-eb22-4fa8-a7aa-2df95717aab1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:57.032603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:57.033721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:57.034697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:57.034697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:57.034697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:57.034697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:57.034697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:57.034697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:57.034697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:57.034697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:57.034697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:57.034697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:57.034697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:47:57.034697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:47:57.034697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 155/307] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:57.036861 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4bf90-0b55-45c6-a4bf-b546a3a9fd01 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:57.037369 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4bf90-0b55-45c6-a4bf-b546a3a9fd01 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:57.037850 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4bf90-0b55-45c6-a4bf-b546a3a9fd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:57.055575 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-07b4bf90-0b55-45c6-a4bf-b546a3a9fd01 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:57.056804 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-07b4bf90-0b55-45c6-a4bf-b546a3a9fd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:57.093666 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:57.124316 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427d424-0051-44a2-ae5f-ce64abc02553 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:57.139346 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 156/308] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:57.140571 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4bf90-0b55-45c6-a4bf-b546a3a9fd01 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:57.186091 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c64843-e5af-4f07-87b9-65b5c48b3ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:57.186761 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c64843-e5af-4f07-87b9-65b5c48b3ebd None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:57.187055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c64843-e5af-4f07-87b9-65b5c48b3ebd None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:57.187328 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c64843-e5af-4f07-87b9-65b5c48b3ebd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:57.188196 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c64843-e5af-4f07-87b9-65b5c48b3ebd None admin] RBAC: Adding query filter params (role.id=478bbce5a7b34a23aabf38a0d1789a54, user.id=2878bd4ea618480aa6f4dad183d67f20, scope.system=all) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:57.188516 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c64843-e5af-4f07-87b9-65b5c48b3ebd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:57.190449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c64843-e5af-4f07-87b9-65b5c48b3ebd None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:57.208145 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 153/309] 10.222.0.49 () {56 vars in 1308 bytes} [Thu Jul 14 11:47:57 2022] GET /identity/v3/role_assignments?user.id=2878bd4ea618480aa6f4dad183d67f20&scope.system=all&role.id=478bbce5a7b34a23aabf38a0d1789a54 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:57.208145 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c64843-e5af-4f07-87b9-65b5c48b3ebd None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:57.272747 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4bf90-0b55-45c6-a4bf-b546a3a9fd01 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:57.288328 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:57.321266 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d069d1-73f6-4b2c-8d05-37c4bd4af5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:57.321951 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d069d1-73f6-4b2c-8d05-37c4bd4af5d8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:57.322238 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d069d1-73f6-4b2c-8d05-37c4bd4af5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:57.322520 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d069d1-73f6-4b2c-8d05-37c4bd4af5d8 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:57.323418 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d069d1-73f6-4b2c-8d05-37c4bd4af5d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:57.323744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d069d1-73f6-4b2c-8d05-37c4bd4af5d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:57.325793 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d069d1-73f6-4b2c-8d05-37c4bd4af5d8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:57.339434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 157/310] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:57.346289 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d069d1-73f6-4b2c-8d05-37c4bd4af5d8 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:57.359971 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c64843-e5af-4f07-87b9-65b5c48b3ebd None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:57.409579 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df2ef7-9061-476a-a5c9-ccf4ff1d3d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:57.410420 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df2ef7-9061-476a-a5c9-ccf4ff1d3d43 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:57.411142 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df2ef7-9061-476a-a5c9-ccf4ff1d3d43 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:57.411429 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df2ef7-9061-476a-a5c9-ccf4ff1d3d43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:57.415171 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:57.427752 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df2ef7-9061-476a-a5c9-ccf4ff1d3d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-75df2ef7-9061-476a-a5c9-ccf4ff1d3d43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:57.438642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:57.439532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:57.440738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:57.440738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:57.440738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:57.440738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:57.440738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:57.440738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:57.440738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:57.440738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:57.440738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:57.440738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:57.440738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:57.440738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:47:57.440738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 154/311] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:57.446002 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df2ef7-9061-476a-a5c9-ccf4ff1d3d43 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:57.483268 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d069d1-73f6-4b2c-8d05-37c4bd4af5d8 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:57.520559 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f17bf-77fc-49f3-b201-edbadadcd75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:57.521760 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f17bf-77fc-49f3-b201-edbadadcd75f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:57.522224 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f17bf-77fc-49f3-b201-edbadadcd75f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:57.522678 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f17bf-77fc-49f3-b201-edbadadcd75f None admin] PATH_INFO: `/v3/users/4f51381eca5d4595b6544560a402b653` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:57.524133 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f17bf-77fc-49f3-b201-edbadadcd75f None admin] RBAC: Authorizing `identity:get_user(user_id=4f51381eca5d4595b6544560a402b653)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:57.525755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f17bf-77fc-49f3-b201-edbadadcd75f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:57.528384 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 158/312] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:57 2022] GET /identity/v3/users/4f51381eca5d4595b6544560a402b653 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:57.534321 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f17bf-77fc-49f3-b201-edbadadcd75f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:57.558007 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df2ef7-9061-476a-a5c9-ccf4ff1d3d43 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:57.577737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:57.594919 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a7669-2a9b-4305-b065-8fe9801c3ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:57.595810 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a7669-2a9b-4305-b065-8fe9801c3ae9 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:57.596211 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a7669-2a9b-4305-b065-8fe9801c3ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:57.596640 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a7669-2a9b-4305-b065-8fe9801c3ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:57.597374 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a7669-2a9b-4305-b065-8fe9801c3ae9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:57.597771 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a7669-2a9b-4305-b065-8fe9801c3ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:57.599217 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a7669-2a9b-4305-b065-8fe9801c3ae9 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:57.608046 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 155/313] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:57.613434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a7669-2a9b-4305-b065-8fe9801c3ae9 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:57.648131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f17bf-77fc-49f3-b201-edbadadcd75f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:57.675977 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:57.686473 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cb32a-cec8-440a-b69e-1f8022dc4903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:57.687776 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cb32a-cec8-440a-b69e-1f8022dc4903 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:57.688288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cb32a-cec8-440a-b69e-1f8022dc4903 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:57.688785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cb32a-cec8-440a-b69e-1f8022dc4903 None admin] PATH_INFO: `/v3/system/users/4f51381eca5d4595b6544560a402b653/roles/7b517960be1c437d850537c7e0aa985a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:57.690480 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cb32a-cec8-440a-b69e-1f8022dc4903 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4f51381eca5d4595b6544560a402b653, role_id=7b517960be1c437d850537c7e0aa985a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:57.692118 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cb32a-cec8-440a-b69e-1f8022dc4903 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:57.702194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 159/314] 10.222.0.49 () {58 vars in 1334 bytes} [Thu Jul 14 11:47:57 2022] PUT /identity/v3/system/users/4f51381eca5d4595b6544560a402b653/roles/7b517960be1c437d850537c7e0aa985a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:47:57.727362 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a7669-2a9b-4305-b065-8fe9801c3ae9 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:57.769121 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba0342-c6c2-4d37-97e8-49487808874d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:57.769938 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba0342-c6c2-4d37-97e8-49487808874d None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:57.770226 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba0342-c6c2-4d37-97e8-49487808874d None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:57.770508 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba0342-c6c2-4d37-97e8-49487808874d None admin] PATH_INFO: `/v3/users/8361df619bd7409aa8bf4e3703084e07` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:57.771783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba0342-c6c2-4d37-97e8-49487808874d None admin] RBAC: Authorizing `identity:get_user(user_id=8361df619bd7409aa8bf4e3703084e07)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:57.773425 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba0342-c6c2-4d37-97e8-49487808874d None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:57.775369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 156/315] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:47:57 2022] GET /identity/v3/users/8361df619bd7409aa8bf4e3703084e07 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:57.780863 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cb32a-cec8-440a-b69e-1f8022dc4903 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:57.905779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cb32a-cec8-440a-b69e-1f8022dc4903 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:57.907625 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:57.944879 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d5a7b-b86b-41aa-9f29-9a7a609e5713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:57.945535 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d5a7b-b86b-41aa-9f29-9a7a609e5713 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:57.945820 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d5a7b-b86b-41aa-9f29-9a7a609e5713 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:57.946095 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d5a7b-b86b-41aa-9f29-9a7a609e5713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:58.026560 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d5a7b-b86b-41aa-9f29-9a7a609e5713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:58.028063 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d5a7b-b86b-41aa-9f29-9a7a609e5713 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:58.131385 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 160/316] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:47:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:58.137287 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba0342-c6c2-4d37-97e8-49487808874d None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:58.249919 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba0342-c6c2-4d37-97e8-49487808874d None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:58.284609 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:58.286426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a038b-aee0-4f96-bd98-09aaaa9c9dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:58.287607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a038b-aee0-4f96-bd98-09aaaa9c9dc4 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:58.287914 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a038b-aee0-4f96-bd98-09aaaa9c9dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:58.288204 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a038b-aee0-4f96-bd98-09aaaa9c9dc4 None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:58.289465 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a038b-aee0-4f96-bd98-09aaaa9c9dc4 None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:58.290921 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a038b-aee0-4f96-bd98-09aaaa9c9dc4 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:58.298326 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 157/317] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:47:58 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:58.299094 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d5a7b-b86b-41aa-9f29-9a7a609e5713 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:58.301298 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:58.407779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d5a7b-b86b-41aa-9f29-9a7a609e5713 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:58.446399 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3190b47-3c03-4f78-9794-ebc7a56f9ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:58.447063 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3190b47-3c03-4f78-9794-ebc7a56f9ab2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:58.447351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3190b47-3c03-4f78-9794-ebc7a56f9ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:58.447635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3190b47-3c03-4f78-9794-ebc7a56f9ab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:58.448496 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3190b47-3c03-4f78-9794-ebc7a56f9ab2 None admin] RBAC: Adding query filter params (role.id=478bbce5a7b34a23aabf38a0d1789a54, scope.project.id=3bab82494d694b8db2b6698451bdf404, user.id=8361df619bd7409aa8bf4e3703084e07) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:47:58.448814 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3190b47-3c03-4f78-9794-ebc7a56f9ab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:58.450272 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3190b47-3c03-4f78-9794-ebc7a56f9ab2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:58.457311 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 161/318] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:47:58 2022] GET /identity/v3/role_assignments?user.id=8361df619bd7409aa8bf4e3703084e07&scope.project.id=3bab82494d694b8db2b6698451bdf404&role.id=478bbce5a7b34a23aabf38a0d1789a54 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:47:59.021260 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958d90e-2aaa-4496-8f9c-8f1387a0812d None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:59.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958d90e-2aaa-4496-8f9c-8f1387a0812d None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:59.021832 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958d90e-2aaa-4496-8f9c-8f1387a0812d None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:59.023330 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 158/319] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:59.028283 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cda288-f9d8-40a4-bc39-d51632e6c751 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:59.028578 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cda288-f9d8-40a4-bc39-d51632e6c751 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:59.028858 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cda288-f9d8-40a4-bc39-d51632e6c751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:59.047328 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-41cda288-f9d8-40a4-bc39-d51632e6c751 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:59.048548 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-41cda288-f9d8-40a4-bc39-d51632e6c751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:59.112236 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:59.121834 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 162/320] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:59.146055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958d90e-2aaa-4496-8f9c-8f1387a0812d None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:59.257340 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958d90e-2aaa-4496-8f9c-8f1387a0812d None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:59.292150 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27497e97-4916-4a4e-ab55-b8b7e1614d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:59.292843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27497e97-4916-4a4e-ab55-b8b7e1614d94 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:59.293125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27497e97-4916-4a4e-ab55-b8b7e1614d94 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:59.293399 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27497e97-4916-4a4e-ab55-b8b7e1614d94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:59.294537 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27497e97-4916-4a4e-ab55-b8b7e1614d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:59.296049 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27497e97-4916-4a4e-ab55-b8b7e1614d94 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:59.297812 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 159/321] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:47:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:47:59.303093 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cda288-f9d8-40a4-bc39-d51632e6c751 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:59.408622 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cda288-f9d8-40a4-bc39-d51632e6c751 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:59.449525 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd60f0-e68b-4ca4-a7cd-896efe04ef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:59.450191 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd60f0-e68b-4ca4-a7cd-896efe04ef51 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:59.450553 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd60f0-e68b-4ca4-a7cd-896efe04ef51 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:59.450832 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd60f0-e68b-4ca4-a7cd-896efe04ef51 None admin] PATH_INFO: `/v3/groups` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:59.451528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd60f0-e68b-4ca4-a7cd-896efe04ef51 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:47:59.453294 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd60f0-e68b-4ca4-a7cd-896efe04ef51 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:47:59.470770 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 163/322] 10.222.0.49 () {60 vars in 1134 bytes} [Thu Jul 14 11:47:59 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:47:59.566813 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5deaa-2869-4b77-bed6-ad0e4c3610a2 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:59.566999 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5deaa-2869-4b77-bed6-ad0e4c3610a2 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:59.567276 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5deaa-2869-4b77-bed6-ad0e4c3610a2 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:59.568888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 160/323] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:47:59.574545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d328c-9e5d-40a8-83df-420f5c88400d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:59.574914 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d328c-9e5d-40a8-83df-420f5c88400d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:59.575133 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d328c-9e5d-40a8-83df-420f5c88400d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:59.594110 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e51d328c-9e5d-40a8-83df-420f5c88400d None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:47:59.595338 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e51d328c-9e5d-40a8-83df-420f5c88400d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:47:59.652609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:59.672558 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 164/324] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:59.696972 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5deaa-2869-4b77-bed6-ad0e4c3610a2 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:47:59.774349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:59.819537 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5deaa-2869-4b77-bed6-ad0e4c3610a2 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:47:59.856814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b746bbf-84e7-4faf-867a-fafb53a813ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:47:59.857972 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746bbf-84e7-4faf-867a-fafb53a813ac None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:47:59.858480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746bbf-84e7-4faf-867a-fafb53a813ac None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:47:59.859474 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746bbf-84e7-4faf-867a-fafb53a813ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:47:59.871303 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b746bbf-84e7-4faf-867a-fafb53a813ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-0b746bbf-84e7-4faf-867a-fafb53a813ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:47:59.880012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:47:59.880959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:47:59.881768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:47:59.881768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:47:59.881768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:47:59.881768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:47:59.881768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:47:59.881768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:47:59.881768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:47:59.881768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:47:59.881768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:47:59.881768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:47:59.881768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:47:59.881768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:47:59.881768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 161/325] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:47:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:47:59.887990 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d328c-9e5d-40a8-83df-420f5c88400d None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:00.008903 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d328c-9e5d-40a8-83df-420f5c88400d None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:00.051585 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804ce85-01e5-459f-a48d-3e1f62aecc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:00.052323 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804ce85-01e5-459f-a48d-3e1f62aecc84 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:00.052614 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804ce85-01e5-459f-a48d-3e1f62aecc84 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:00.052896 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804ce85-01e5-459f-a48d-3e1f62aecc84 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:00.053656 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804ce85-01e5-459f-a48d-3e1f62aecc84 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:00.053972 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804ce85-01e5-459f-a48d-3e1f62aecc84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:00.055365 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804ce85-01e5-459f-a48d-3e1f62aecc84 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:00.064759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 165/326] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:47:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:00.070463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b746bbf-84e7-4faf-867a-fafb53a813ac None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:00.104008 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887457a9-0d48-49eb-a215-f38bc2806b88 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:00.104686 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887457a9-0d48-49eb-a215-f38bc2806b88 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:00.105203 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887457a9-0d48-49eb-a215-f38bc2806b88 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:00.107100 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 166/327] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:48:00.112356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3213f6b-e65f-4550-9aa5-12b6245dac9c None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:00.112906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3213f6b-e65f-4550-9aa5-12b6245dac9c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:00.113380 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3213f6b-e65f-4550-9aa5-12b6245dac9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:00.136616 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b3213f6b-e65f-4550-9aa5-12b6245dac9c None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:00.138252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b3213f6b-e65f-4550-9aa5-12b6245dac9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:00.207820 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:00.237040 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 167/328] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:48:00.255401 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b746bbf-84e7-4faf-867a-fafb53a813ac None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:00.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3213f6b-e65f-4550-9aa5-12b6245dac9c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:00.284313 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:00.301500 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83d9bd-64a7-4051-88a9-af0b48117e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:00.302652 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83d9bd-64a7-4051-88a9-af0b48117e3f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:00.303099 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83d9bd-64a7-4051-88a9-af0b48117e3f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:00.303535 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83d9bd-64a7-4051-88a9-af0b48117e3f None admin] PATH_INFO: `/v3/users/2878bd4ea618480aa6f4dad183d67f20` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:00.305257 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83d9bd-64a7-4051-88a9-af0b48117e3f None admin] RBAC: Authorizing `identity:get_user(user_id=2878bd4ea618480aa6f4dad183d67f20)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:00.307172 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83d9bd-64a7-4051-88a9-af0b48117e3f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:00.309352 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 162/329] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:48:00 2022] GET /identity/v3/users/2878bd4ea618480aa6f4dad183d67f20 => generated 293 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:00.316337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83d9bd-64a7-4051-88a9-af0b48117e3f None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:00.441151 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3213f6b-e65f-4550-9aa5-12b6245dac9c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:00.451404 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83d9bd-64a7-4051-88a9-af0b48117e3f None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:00.498298 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be23d31-f408-44ed-8763-f5715944175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:00.499176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be23d31-f408-44ed-8763-f5715944175a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:00.499509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be23d31-f408-44ed-8763-f5715944175a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:00.499794 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be23d31-f408-44ed-8763-f5715944175a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:00.520544 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af91729-3a45-4fde-937f-82921c9f5b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:00.521428 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af91729-3a45-4fde-937f-82921c9f5b72 None admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:00.521971 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af91729-3a45-4fde-937f-82921c9f5b72 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:00.522254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af91729-3a45-4fde-937f-82921c9f5b72 None admin] PATH_INFO: `/v3/system/users/2878bd4ea618480aa6f4dad183d67f20/roles/478bbce5a7b34a23aabf38a0d1789a54` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:00.523856 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af91729-3a45-4fde-937f-82921c9f5b72 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2878bd4ea618480aa6f4dad183d67f20, role_id=478bbce5a7b34a23aabf38a0d1789a54)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:00.525264 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af91729-3a45-4fde-937f-82921c9f5b72 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:00.526698 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be23d31-f408-44ed-8763-f5715944175a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-6be23d31-f408-44ed-8763-f5715944175a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:00.535507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:00.536481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:00.537240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:00.537240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:00.537240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:00.537240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:00.537240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:00.537240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:00.537240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:00.537240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:00.537240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:00.537240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:00.537240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:48:00.537240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:00.537839 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 168/330] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:00.543793 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be23d31-f408-44ed-8763-f5715944175a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:00.560660 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 163/331] 10.222.0.49 () {58 vars in 1334 bytes} [Thu Jul 14 11:48:00 2022] PUT /identity/v3/system/users/2878bd4ea618480aa6f4dad183d67f20/roles/478bbce5a7b34a23aabf38a0d1789a54 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:48:00.622607 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:00.705778 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be23d31-f408-44ed-8763-f5715944175a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:00.753236 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eee6b-91ca-47bd-924c-ba42b2d09141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:00.754042 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eee6b-91ca-47bd-924c-ba42b2d09141 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:00.754327 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eee6b-91ca-47bd-924c-ba42b2d09141 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:00.754607 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eee6b-91ca-47bd-924c-ba42b2d09141 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:00.755366 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eee6b-91ca-47bd-924c-ba42b2d09141 None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:00.755676 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eee6b-91ca-47bd-924c-ba42b2d09141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:00.757127 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eee6b-91ca-47bd-924c-ba42b2d09141 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:00.768086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 169/332] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:48:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:00.774652 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af91729-3a45-4fde-937f-82921c9f5b72 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:00.853359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:00.919847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af91729-3a45-4fde-937f-82921c9f5b72 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:00.957879 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee2b28-3fed-4845-8577-24936b44d9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:00.958678 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee2b28-3fed-4845-8577-24936b44d9ec None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:00.958961 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee2b28-3fed-4845-8577-24936b44d9ec None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:00.959237 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee2b28-3fed-4845-8577-24936b44d9ec None admin] PATH_INFO: `/v3/users/4f51381eca5d4595b6544560a402b653` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:00.960689 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee2b28-3fed-4845-8577-24936b44d9ec None admin] RBAC: Authorizing `identity:get_user(user_id=4f51381eca5d4595b6544560a402b653)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:00.962254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee2b28-3fed-4845-8577-24936b44d9ec None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:00.964258 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 164/333] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:48:00 2022] GET /identity/v3/users/4f51381eca5d4595b6544560a402b653 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:00.972191 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eee6b-91ca-47bd-924c-ba42b2d09141 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:01.089113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:01.093221 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eee6b-91ca-47bd-924c-ba42b2d09141 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:01.132066 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddaf89-7968-4a49-8388-b226a98a55a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:01.132729 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddaf89-7968-4a49-8388-b226a98a55a5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:01.133011 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddaf89-7968-4a49-8388-b226a98a55a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:01.133286 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddaf89-7968-4a49-8388-b226a98a55a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:01.134125 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddaf89-7968-4a49-8388-b226a98a55a5 None admin] RBAC: Adding query filter params (role.id=7b517960be1c437d850537c7e0aa985a, user.id=4f51381eca5d4595b6544560a402b653, scope.system=all) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:01.134437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddaf89-7968-4a49-8388-b226a98a55a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:01.136134 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddaf89-7968-4a49-8388-b226a98a55a5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:01.149914 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 170/334] 10.222.0.49 () {56 vars in 1308 bytes} [Thu Jul 14 11:48:00 2022] GET /identity/v3/role_assignments?user.id=4f51381eca5d4595b6544560a402b653&scope.system=all&role.id=7b517960be1c437d850537c7e0aa985a => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:02.823728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae716c21-8dd2-43eb-9615-09dbb2ea2294 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:02.824264 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae716c21-8dd2-43eb-9615-09dbb2ea2294 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:02.824367 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae716c21-8dd2-43eb-9615-09dbb2ea2294 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:02.825959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 165/335] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:02.831610 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb1047-dcf8-4fbf-bdf1-2f96b50df446 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:02.832863 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb1047-dcf8-4fbf-bdf1-2f96b50df446 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:02.833158 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb1047-dcf8-4fbf-bdf1-2f96b50df446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:02.857160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e8bb1047-dcf8-4fbf-bdf1-2f96b50df446 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:02.858441 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e8bb1047-dcf8-4fbf-bdf1-2f96b50df446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:02.945399 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826731c-e8d9-4856-833c-aec5344c099f None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:02.945718 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826731c-e8d9-4856-833c-aec5344c099f None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:02.945974 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826731c-e8d9-4856-833c-aec5344c099f None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:02.947480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 166/336] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:48:02.949940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 171/337] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:02.952777 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1851bf-89dc-46b7-8f33-335d2112fc8e None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:02.953070 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1851bf-89dc-46b7-8f33-335d2112fc8e None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:02.953357 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1851bf-89dc-46b7-8f33-335d2112fc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:02.974690 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-1c1851bf-89dc-46b7-8f33-335d2112fc8e None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:02.975977 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-1c1851bf-89dc-46b7-8f33-335d2112fc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:02.984266 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb1047-dcf8-4fbf-bdf1-2f96b50df446 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:03.107329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 167/338] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:48:03.110072 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:03.125950 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb1047-dcf8-4fbf-bdf1-2f96b50df446 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:03.163693 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a12bd-6a8c-4508-b519-74807073a181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:03.164765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a12bd-6a8c-4508-b519-74807073a181 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:03.165058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a12bd-6a8c-4508-b519-74807073a181 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:03.165343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a12bd-6a8c-4508-b519-74807073a181 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:03.166436 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1851bf-89dc-46b7-8f33-335d2112fc8e None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:03.179573 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a12bd-6a8c-4508-b519-74807073a181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-0f0a12bd-6a8c-4508-b519-74807073a181 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:03.189155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:03.190035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:03.190803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:03.190803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:03.190803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:03.190803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:03.190803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:03.190803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:03.190803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:03.190803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:03.190803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:03.190803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:03.190803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:48:03.190803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:03.190803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 172/339] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:48:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:03.201221 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a12bd-6a8c-4508-b519-74807073a181 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:03.261478 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:03.357835 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1851bf-89dc-46b7-8f33-335d2112fc8e None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:03.406320 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a12bd-6a8c-4508-b519-74807073a181 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:03.440638 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2871db-842a-42de-abdb-a475ea4a3e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:03.441458 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2871db-842a-42de-abdb-a475ea4a3e8b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:03.441744 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2871db-842a-42de-abdb-a475ea4a3e8b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:03.442098 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2871db-842a-42de-abdb-a475ea4a3e8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:03.463953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158735e7-8cb7-4866-b0e0-f60b97796b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:03.464546 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158735e7-8cb7-4866-b0e0-f60b97796b1c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:03.464838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158735e7-8cb7-4866-b0e0-f60b97796b1c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:03.465124 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158735e7-8cb7-4866-b0e0-f60b97796b1c None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:03.465886 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158735e7-8cb7-4866-b0e0-f60b97796b1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:03.466256 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158735e7-8cb7-4866-b0e0-f60b97796b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:03.467664 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158735e7-8cb7-4866-b0e0-f60b97796b1c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:03.472914 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2871db-842a-42de-abdb-a475ea4a3e8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:03.482571 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 173/340] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-db2871db-842a-42de-abdb-a475ea4a3e8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:03.484909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:03.485773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:03.486540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:03.486540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:03.486540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:03.486540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:03.486540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:03.486540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:03.486540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:03.486540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:03.486540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:03.486540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:03.486540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:48:03.486540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:03.490163 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 168/341] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:03.491469 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158735e7-8cb7-4866-b0e0-f60b97796b1c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:03.492583 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2871db-842a-42de-abdb-a475ea4a3e8b None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:03.508284 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:03.637490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158735e7-8cb7-4866-b0e0-f60b97796b1c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:03.704622 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aef07c-0a62-41a1-ae67-4ae2cb661bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:03.705667 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aef07c-0a62-41a1-ae67-4ae2cb661bfe None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:03.706168 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aef07c-0a62-41a1-ae67-4ae2cb661bfe None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:03.706643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aef07c-0a62-41a1-ae67-4ae2cb661bfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:03.709254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2871db-842a-42de-abdb-a475ea4a3e8b None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:03.728264 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:03.768704 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388986c-95cf-47f6-8054-c00a38394edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:03.769388 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388986c-95cf-47f6-8054-c00a38394edc None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:03.769675 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388986c-95cf-47f6-8054-c00a38394edc None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:03.769957 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388986c-95cf-47f6-8054-c00a38394edc None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:03.770741 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388986c-95cf-47f6-8054-c00a38394edc None admin] RBAC: Adding query filter params (name=member) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:03.771052 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388986c-95cf-47f6-8054-c00a38394edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:03.772461 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388986c-95cf-47f6-8054-c00a38394edc None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:03.790277 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 169/342] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:48:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:03.795746 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388986c-95cf-47f6-8054-c00a38394edc None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:03.850699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aef07c-0a62-41a1-ae67-4ae2cb661bfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:03.852222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aef07c-0a62-41a1-ae67-4ae2cb661bfe None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:03.875977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:03.995984 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388986c-95cf-47f6-8054-c00a38394edc None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:04.050799 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3689a77-f945-4f16-8baf-665f15026267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:04.051651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3689a77-f945-4f16-8baf-665f15026267 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:04.051973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3689a77-f945-4f16-8baf-665f15026267 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:04.052331 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3689a77-f945-4f16-8baf-665f15026267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:04.089605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 174/343] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:04.097447 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aef07c-0a62-41a1-ae67-4ae2cb661bfe None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:04.163461 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:04.213773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3689a77-f945-4f16-8baf-665f15026267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:04.215243 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3689a77-f945-4f16-8baf-665f15026267 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:04.307034 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aef07c-0a62-41a1-ae67-4ae2cb661bfe None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:04.335293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:04.374012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966324c-0a3e-4966-8da1-fbaf05d2fe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:04.374888 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966324c-0a3e-4966-8da1-fbaf05d2fe6c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:04.375171 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966324c-0a3e-4966-8da1-fbaf05d2fe6c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:04.375448 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966324c-0a3e-4966-8da1-fbaf05d2fe6c None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:04.376660 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966324c-0a3e-4966-8da1-fbaf05d2fe6c None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:04.378115 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966324c-0a3e-4966-8da1-fbaf05d2fe6c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:04.380012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 175/344] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:48:04 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:04.381877 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e89f26-97e2-4604-9485-751a9c66755d None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:04.382167 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e89f26-97e2-4604-9485-751a9c66755d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:04.382486 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e89f26-97e2-4604-9485-751a9c66755d None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:04.388852 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 176/345] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:04.390145 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21e8ee-a8ea-4128-a84d-40e43fb2718e None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:04.390439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21e8ee-a8ea-4128-a84d-40e43fb2718e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:04.390723 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21e8ee-a8ea-4128-a84d-40e43fb2718e None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:04.392105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 177/346] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:04.393003 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21e8ee-a8ea-4128-a84d-40e43fb2718e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:04.393111 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 170/347] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:04.394365 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724886-f6bf-4ade-ac10-52c63f8a1f83 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:04.394655 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724886-f6bf-4ade-ac10-52c63f8a1f83 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:04.394932 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724886-f6bf-4ade-ac10-52c63f8a1f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:04.414031 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-ec724886-f6bf-4ade-ac10-52c63f8a1f83 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:04.415284 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-ec724886-f6bf-4ade-ac10-52c63f8a1f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:04.514912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 171/348] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:04.516366 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398b147-d133-4783-9bd1-6736c6a3596f None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:04.516657 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398b147-d133-4783-9bd1-6736c6a3596f None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:04.516937 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398b147-d133-4783-9bd1-6736c6a3596f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:04.533104 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:04.552849 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-e398b147-d133-4783-9bd1-6736c6a3596f None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:04.555426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-e398b147-d133-4783-9bd1-6736c6a3596f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:04.559843 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21e8ee-a8ea-4128-a84d-40e43fb2718e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:04.603530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbee55-6e3e-41f1-afd9-53fcf32b35e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:04.604473 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbee55-6e3e-41f1-afd9-53fcf32b35e7 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:04.604756 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbee55-6e3e-41f1-afd9-53fcf32b35e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:04.605034 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbee55-6e3e-41f1-afd9-53fcf32b35e7 None admin] PATH_INFO: `/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:04.614924 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbee55-6e3e-41f1-afd9-53fcf32b35e7 None admin] RBAC: Authorizing `identity:get_group(group_id=cb0fe99fc83e4a8eab48a80f05e6994a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:04.617155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbee55-6e3e-41f1-afd9-53fcf32b35e7 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:04.618979 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 178/349] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 14 11:48:04 2022] GET /identity/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:04.619764 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbee55-6e3e-41f1-afd9-53fcf32b35e7 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:04.647226 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 172/350] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:04.648630 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398b147-d133-4783-9bd1-6736c6a3596f None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:04.675256 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:04.747330 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbee55-6e3e-41f1-afd9-53fcf32b35e7 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:04.779140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398b147-d133-4783-9bd1-6736c6a3596f None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:04.784411 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6251b7-635b-4e13-8746-1897c4a1bc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:04.785288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6251b7-635b-4e13-8746-1897c4a1bc88 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:04.785575 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6251b7-635b-4e13-8746-1897c4a1bc88 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:04.785857 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6251b7-635b-4e13-8746-1897c4a1bc88 None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:04.788904 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6251b7-635b-4e13-8746-1897c4a1bc88 None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:04.790370 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6251b7-635b-4e13-8746-1897c4a1bc88 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:04.794104 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 179/351] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:48:04 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:04.794753 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6251b7-635b-4e13-8746-1897c4a1bc88 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:04.818796 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3697940-8d7c-47f6-ae0d-0309b876bd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:04.819976 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3697940-8d7c-47f6-ae0d-0309b876bd71 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:04.819976 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3697940-8d7c-47f6-ae0d-0309b876bd71 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:04.820178 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3697940-8d7c-47f6-ae0d-0309b876bd71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:04.823913 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:04.834640 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3697940-8d7c-47f6-ae0d-0309b876bd71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-e3697940-8d7c-47f6-ae0d-0309b876bd71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:04.842607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:04.843555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:04.844363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:04.844363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:04.844363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:04.844363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:04.844363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:04.844363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:04.844363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:04.844363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:04.844363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:04.844363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:04.844363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:48:04.844363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:04.845475 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 173/352] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:04.846650 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3697940-8d7c-47f6-ae0d-0309b876bd71 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:04.923378 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6251b7-635b-4e13-8746-1897c4a1bc88 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:04.937898 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:04.972739 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbb1ba-bb05-4cf9-88f2-691a9450abf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:04.973430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbb1ba-bb05-4cf9-88f2-691a9450abf5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:04.973715 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbb1ba-bb05-4cf9-88f2-691a9450abf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:04.973991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbb1ba-bb05-4cf9-88f2-691a9450abf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:04.974812 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbb1ba-bb05-4cf9-88f2-691a9450abf5 None admin] RBAC: Adding query filter params (group.id=cb0fe99fc83e4a8eab48a80f05e6994a, role.id=703199a2f03143128fbac7cc8481b912, scope.project.id=d9040b944c534111b0b4718481683172) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:04.975119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbb1ba-bb05-4cf9-88f2-691a9450abf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:04.977342 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbb1ba-bb05-4cf9-88f2-691a9450abf5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:04.984332 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 180/353] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 14 11:48:04 2022] GET /identity/v3/role_assignments?group.id=cb0fe99fc83e4a8eab48a80f05e6994a&scope.project.id=d9040b944c534111b0b4718481683172&role.id=703199a2f03143128fbac7cc8481b912 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:04.985651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5d572-23f0-4360-b058-8db590d508da None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:04.985861 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5d572-23f0-4360-b058-8db590d508da None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:04.986235 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5d572-23f0-4360-b058-8db590d508da None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:04.987553 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 181/354] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:04.992365 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3697940-8d7c-47f6-ae0d-0309b876bd71 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:04.992566 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b18cf7-248e-4744-b562-eb8066acf5df None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:04.992566 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b18cf7-248e-4744-b562-eb8066acf5df None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:04.992566 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b18cf7-248e-4744-b562-eb8066acf5df None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:04.992566 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 182/355] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:04.992566 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b18cf7-248e-4744-b562-eb8066acf5df None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:05.047373 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfcc37-63dd-4964-9ada-5b8f846f909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:05.048283 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfcc37-63dd-4964-9ada-5b8f846f909b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:05.048576 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfcc37-63dd-4964-9ada-5b8f846f909b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:05.048854 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfcc37-63dd-4964-9ada-5b8f846f909b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:05.063627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfcc37-63dd-4964-9ada-5b8f846f909b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-74bfcc37-63dd-4964-9ada-5b8f846f909b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:05.072205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:05.073122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:05.073900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:05.073900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:05.073900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:05.073900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:05.073900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:05.073900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:05.073900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:05.073900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:05.073900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:05.073900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:05.073900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:48:05.073900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:05.073900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 174/356] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:48:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:05.073900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfcc37-63dd-4964-9ada-5b8f846f909b None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:05.123488 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b18cf7-248e-4744-b562-eb8066acf5df None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:05.179544 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:05.192278 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39b07c-4264-4821-bc28-8ed118cd8f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:05.193958 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39b07c-4264-4821-bc28-8ed118cd8f3d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:05.194610 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39b07c-4264-4821-bc28-8ed118cd8f3d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:05.194610 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39b07c-4264-4821-bc28-8ed118cd8f3d None admin] PATH_INFO: `/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:05.198033 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39b07c-4264-4821-bc28-8ed118cd8f3d None admin] RBAC: Authorizing `identity:get_group(group_id=cb0fe99fc83e4a8eab48a80f05e6994a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:05.199520 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39b07c-4264-4821-bc28-8ed118cd8f3d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:05.202069 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 183/357] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 14 11:48:04 2022] GET /identity/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:05.203873 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067c616-cdd7-407f-aee7-7c152ba6d70a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:05.204564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067c616-cdd7-407f-aee7-7c152ba6d70a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:05.204851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067c616-cdd7-407f-aee7-7c152ba6d70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:05.225044 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-4067c616-cdd7-407f-aee7-7c152ba6d70a None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:05.226843 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4067c616-cdd7-407f-aee7-7c152ba6d70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:05.232112 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfcc37-63dd-4964-9ada-5b8f846f909b None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:05.266236 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:05.279523 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff8b93-93d7-4f4c-a7b7-5e3fbacad01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:05.280631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff8b93-93d7-4f4c-a7b7-5e3fbacad01b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:05.281087 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff8b93-93d7-4f4c-a7b7-5e3fbacad01b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:05.281372 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff8b93-93d7-4f4c-a7b7-5e3fbacad01b None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:05.284279 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff8b93-93d7-4f4c-a7b7-5e3fbacad01b None admin] RBAC: Adding query filter params (name=member) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:05.284605 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff8b93-93d7-4f4c-a7b7-5e3fbacad01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:05.286016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff8b93-93d7-4f4c-a7b7-5e3fbacad01b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:05.297627 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 175/358] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:48:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:05.299366 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4789280-d557-46f5-9cc1-6f884d6060ed None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:05.299661 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4789280-d557-46f5-9cc1-6f884d6060ed None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:05.299966 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4789280-d557-46f5-9cc1-6f884d6060ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:05.308197 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 184/359] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:05.309074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067c616-cdd7-407f-aee7-7c152ba6d70a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:05.319138 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-a4789280-d557-46f5-9cc1-6f884d6060ed None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:05.321369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-a4789280-d557-46f5-9cc1-6f884d6060ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:05.408634 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 176/360] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:05.409835 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4789280-d557-46f5-9cc1-6f884d6060ed None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:05.430482 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067c616-cdd7-407f-aee7-7c152ba6d70a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:05.462642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:05.479970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206abedb-7505-4d7f-876f-4e16e58fdda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:05.481491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206abedb-7505-4d7f-876f-4e16e58fdda1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:05.482000 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206abedb-7505-4d7f-876f-4e16e58fdda1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:05.482493 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206abedb-7505-4d7f-876f-4e16e58fdda1 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:05.483455 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206abedb-7505-4d7f-876f-4e16e58fdda1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:05.484025 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206abedb-7505-4d7f-876f-4e16e58fdda1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:05.485629 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206abedb-7505-4d7f-876f-4e16e58fdda1 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:05.495021 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 185/361] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:05.496197 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206abedb-7505-4d7f-876f-4e16e58fdda1 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:05.530009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4789280-d557-46f5-9cc1-6f884d6060ed None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:05.535088 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:05.575521 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d75b1-ae60-43a5-a73a-b495418f19ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:05.576226 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d75b1-ae60-43a5-a73a-b495418f19ba None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:05.576516 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d75b1-ae60-43a5-a73a-b495418f19ba None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:05.576797 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d75b1-ae60-43a5-a73a-b495418f19ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:05.577635 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d75b1-ae60-43a5-a73a-b495418f19ba None admin] RBAC: Adding query filter params (group.id=cb0fe99fc83e4a8eab48a80f05e6994a, role.id=7b517960be1c437d850537c7e0aa985a, scope.project.id=d9040b944c534111b0b4718481683172) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:05.577952 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d75b1-ae60-43a5-a73a-b495418f19ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:05.579400 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d75b1-ae60-43a5-a73a-b495418f19ba None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:05.588955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 177/362] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 14 11:48:05 2022] GET /identity/v3/role_assignments?group.id=cb0fe99fc83e4a8eab48a80f05e6994a&scope.project.id=d9040b944c534111b0b4718481683172&role.id=7b517960be1c437d850537c7e0aa985a => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:05.589616 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d75b1-ae60-43a5-a73a-b495418f19ba None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:05.636050 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206abedb-7505-4d7f-876f-4e16e58fdda1 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:05.684181 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbec31-8876-41cc-8ecc-da72f291cfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:05.685235 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbec31-8876-41cc-8ecc-da72f291cfc4 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:05.685729 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbec31-8876-41cc-8ecc-da72f291cfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:05.686210 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbec31-8876-41cc-8ecc-da72f291cfc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:05.755134 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d75b1-ae60-43a5-a73a-b495418f19ba None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:05.772073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:05.785139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbec31-8876-41cc-8ecc-da72f291cfc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:05.786798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbec31-8876-41cc-8ecc-da72f291cfc4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:05.811302 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c21aa6-3e56-4d7c-acf4-c52269dd8cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:05.812482 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c21aa6-3e56-4d7c-acf4-c52269dd8cce None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:05.812763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c21aa6-3e56-4d7c-acf4-c52269dd8cce None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:05.813048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c21aa6-3e56-4d7c-acf4-c52269dd8cce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:05.826260 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c21aa6-3e56-4d7c-acf4-c52269dd8cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:05.826530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-c5c21aa6-3e56-4d7c-acf4-c52269dd8cce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:05.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:05.837763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:05.838558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:05.838558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:05.838558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:05.838558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:05.838558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:05.838558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:05.838558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:05.838558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:05.838558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:05.838558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:05.838558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:48:05.838558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:05.838558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 178/363] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:48:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:05.838558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c21aa6-3e56-4d7c-acf4-c52269dd8cce None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:05.901911 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 186/364] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:05.902774 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbec31-8876-41cc-8ecc-da72f291cfc4 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:05.951194 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c21aa6-3e56-4d7c-acf4-c52269dd8cce None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:05.988763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5a451-4f1a-4734-a925-ab50ceaed22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:05.989570 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5a451-4f1a-4734-a925-ab50ceaed22a None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:05.989857 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5a451-4f1a-4734-a925-ab50ceaed22a None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:05.990143 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5a451-4f1a-4734-a925-ab50ceaed22a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:06.001736 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5a451-4f1a-4734-a925-ab50ceaed22a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-f8e5a451-4f1a-4734-a925-ab50ceaed22a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:06.010232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:06.012484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:06.014567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:06.014567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:06.014567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:06.014567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:06.014567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:06.014567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:06.014567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:06.014567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:06.014567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:06.014567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:06.014567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:48:06.014567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:06.014567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 179/365] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:06.014567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5a451-4f1a-4734-a925-ab50ceaed22a None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:06.016335 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbec31-8876-41cc-8ecc-da72f291cfc4 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:06.046357 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:06.053249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b07b38-e2c3-479b-a6fc-3d77d26f6572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:06.053249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b07b38-e2c3-479b-a6fc-3d77d26f6572 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:06.053594 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b07b38-e2c3-479b-a6fc-3d77d26f6572 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:06.053687 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b07b38-e2c3-479b-a6fc-3d77d26f6572 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:06.058865 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:06.127440 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5a451-4f1a-4734-a925-ab50ceaed22a None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:06.139308 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b07b38-e2c3-479b-a6fc-3d77d26f6572 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:06.140856 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b07b38-e2c3-479b-a6fc-3d77d26f6572 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:06.167432 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b4d6e-de67-408d-9e6f-da445b245b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:06.168403 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b4d6e-de67-408d-9e6f-da445b245b52 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:06.169062 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b4d6e-de67-408d-9e6f-da445b245b52 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:06.169569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b4d6e-de67-408d-9e6f-da445b245b52 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:06.170592 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b4d6e-de67-408d-9e6f-da445b245b52 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:06.171102 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b4d6e-de67-408d-9e6f-da445b245b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:06.173077 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b4d6e-de67-408d-9e6f-da445b245b52 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:06.183757 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 180/366] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:06.184742 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b4d6e-de67-408d-9e6f-da445b245b52 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:06.256091 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 187/367] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:06.256869 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b07b38-e2c3-479b-a6fc-3d77d26f6572 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:06.296472 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:06.318656 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:06.340868 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b4d6e-de67-408d-9e6f-da445b245b52 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:06.387337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d3612-8dce-4c0d-a68e-573e046ef94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:06.388504 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d3612-8dce-4c0d-a68e-573e046ef94e None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:06.388794 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d3612-8dce-4c0d-a68e-573e046ef94e None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:06.389322 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d3612-8dce-4c0d-a68e-573e046ef94e None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:06.391258 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d3612-8dce-4c0d-a68e-573e046ef94e None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:06.393653 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d3612-8dce-4c0d-a68e-573e046ef94e None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:06.395984 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 181/368] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:48:06 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:06.396336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b07b38-e2c3-479b-a6fc-3d77d26f6572 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:06.396776 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d3612-8dce-4c0d-a68e-573e046ef94e None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:06.464291 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71243bf4-88cc-4afd-965a-eca3ca4378b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:06.465849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71243bf4-88cc-4afd-965a-eca3ca4378b1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:06.466355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71243bf4-88cc-4afd-965a-eca3ca4378b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:06.467142 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71243bf4-88cc-4afd-965a-eca3ca4378b1 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:06.468165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71243bf4-88cc-4afd-965a-eca3ca4378b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:06.468701 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71243bf4-88cc-4afd-965a-eca3ca4378b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:06.470503 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71243bf4-88cc-4afd-965a-eca3ca4378b1 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:06.482895 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 188/369] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:48:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:06.484271 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71243bf4-88cc-4afd-965a-eca3ca4378b1 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:06.563101 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d3612-8dce-4c0d-a68e-573e046ef94e None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:06.610539 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efeb61-d943-4035-8319-3361b5c58e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:06.611374 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efeb61-d943-4035-8319-3361b5c58e9f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:06.611670 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efeb61-d943-4035-8319-3361b5c58e9f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:06.611987 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efeb61-d943-4035-8319-3361b5c58e9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:06.631004 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:06.641348 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71243bf4-88cc-4afd-965a-eca3ca4378b1 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:06.647064 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:06.683341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e689e0-61d4-4151-b7e7-52c78aab9b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:06.684850 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e689e0-61d4-4151-b7e7-52c78aab9b55 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:06.685527 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e689e0-61d4-4151-b7e7-52c78aab9b55 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:06.685984 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e689e0-61d4-4151-b7e7-52c78aab9b55 None admin] PATH_INFO: `/v3/projects/98e8f9ea0c4446b68d2be9ca4901c939` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:06.687778 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e689e0-61d4-4151-b7e7-52c78aab9b55 None admin] RBAC: Authorizing `identity:get_project(project_id=98e8f9ea0c4446b68d2be9ca4901c939)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:06.689609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e689e0-61d4-4151-b7e7-52c78aab9b55 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:06.692280 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 189/370] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:48:06 2022] GET /identity/v3/projects/98e8f9ea0c4446b68d2be9ca4901c939 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:06.693153 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e689e0-61d4-4151-b7e7-52c78aab9b55 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:06.694479 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efeb61-d943-4035-8319-3361b5c58e9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:06.696188 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efeb61-d943-4035-8319-3361b5c58e9f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:06.825875 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e689e0-61d4-4151-b7e7-52c78aab9b55 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:06.827154 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 182/371] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:06.829484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efeb61-d943-4035-8319-3361b5c58e9f None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:06.879480 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8802f1a-b6fe-47e5-84ed-dd1176a7ed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:06.880549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8802f1a-b6fe-47e5-84ed-dd1176a7ed51 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:06.881630 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8802f1a-b6fe-47e5-84ed-dd1176a7ed51 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:06.881935 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8802f1a-b6fe-47e5-84ed-dd1176a7ed51 None admin] PATH_INFO: `/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:06.883146 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8802f1a-b6fe-47e5-84ed-dd1176a7ed51 None admin] RBAC: Authorizing `identity:get_group(group_id=cb0fe99fc83e4a8eab48a80f05e6994a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:06.885217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8802f1a-b6fe-47e5-84ed-dd1176a7ed51 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:06.887731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 190/372] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 14 11:48:06 2022] GET /identity/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:06.889046 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8802f1a-b6fe-47e5-84ed-dd1176a7ed51 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:06.928292 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:06.940881 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:06.967771 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efeb61-d943-4035-8319-3361b5c58e9f None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:07.011185 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39aa5d3-ccc2-4523-b00d-31e9cc213cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:07.012529 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39aa5d3-ccc2-4523-b00d-31e9cc213cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:07.013052 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39aa5d3-ccc2-4523-b00d-31e9cc213cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:07.013630 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39aa5d3-ccc2-4523-b00d-31e9cc213cd4 None admin] PATH_INFO: `/v3/users/2878bd4ea618480aa6f4dad183d67f20` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:07.016253 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39aa5d3-ccc2-4523-b00d-31e9cc213cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=2878bd4ea618480aa6f4dad183d67f20)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:07.018177 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39aa5d3-ccc2-4523-b00d-31e9cc213cd4 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:07.020713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 183/373] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 14 11:48:06 2022] GET /identity/v3/users/2878bd4ea618480aa6f4dad183d67f20 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:07.021961 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39aa5d3-ccc2-4523-b00d-31e9cc213cd4 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:07.039807 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8802f1a-b6fe-47e5-84ed-dd1176a7ed51 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:07.089484 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707923-3c3b-422e-a4d1-ddcf689e16cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:07.090757 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707923-3c3b-422e-a4d1-ddcf689e16cb None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:07.091254 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707923-3c3b-422e-a4d1-ddcf689e16cb None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:07.091745 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707923-3c3b-422e-a4d1-ddcf689e16cb None admin] PATH_INFO: `/v3/groups/4b49cad6230245008593d306c76d5611` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:07.104289 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2707923-3c3b-422e-a4d1-ddcf689e16cb None admin] RBAC: Authorizing `identity:get_group(group_id=4b49cad6230245008593d306c76d5611)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:07.105877 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2707923-3c3b-422e-a4d1-ddcf689e16cb None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:07.107758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 191/374] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 14 11:48:06 2022] GET /identity/v3/groups/4b49cad6230245008593d306c76d5611 => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:07.108563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707923-3c3b-422e-a4d1-ddcf689e16cb None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:07.163486 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39aa5d3-ccc2-4523-b00d-31e9cc213cd4 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:07.201697 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:07.217573 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92bb3c-1130-4644-9c33-4a297ad23a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:07.219500 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92bb3c-1130-4644-9c33-4a297ad23a3d None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:07.220202 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92bb3c-1130-4644-9c33-4a297ad23a3d None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:07.220772 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92bb3c-1130-4644-9c33-4a297ad23a3d None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:07.224055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92bb3c-1130-4644-9c33-4a297ad23a3d None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:07.227015 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92bb3c-1130-4644-9c33-4a297ad23a3d None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:07.230305 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 184/375] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:48:07 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:07.231557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92bb3c-1130-4644-9c33-4a297ad23a3d None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:07.236868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:07.243771 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707923-3c3b-422e-a4d1-ddcf689e16cb None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:07.285992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aae18c-e2e1-4357-80bd-3f3b353232f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:07.287109 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aae18c-e2e1-4357-80bd-3f3b353232f1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:07.287597 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aae18c-e2e1-4357-80bd-3f3b353232f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:07.288168 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aae18c-e2e1-4357-80bd-3f3b353232f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:07.289205 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aae18c-e2e1-4357-80bd-3f3b353232f1 None admin] RBAC: Adding query filter params (group.id=cb0fe99fc83e4a8eab48a80f05e6994a, role.id=7b517960be1c437d850537c7e0aa985a, scope.project.id=3bab82494d694b8db2b6698451bdf404) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:07.289778 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aae18c-e2e1-4357-80bd-3f3b353232f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:07.291786 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aae18c-e2e1-4357-80bd-3f3b353232f1 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:07.298642 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 192/376] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 14 11:48:07 2022] GET /identity/v3/role_assignments?group.id=cb0fe99fc83e4a8eab48a80f05e6994a&scope.project.id=3bab82494d694b8db2b6698451bdf404&role.id=7b517960be1c437d850537c7e0aa985a => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:07.299772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aae18c-e2e1-4357-80bd-3f3b353232f1 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:07.352405 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92bb3c-1130-4644-9c33-4a297ad23a3d None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:07.391625 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca108d5d-83a2-48c1-8bfc-1ca543c3b86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:07.392320 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca108d5d-83a2-48c1-8bfc-1ca543c3b86a None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:07.392603 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca108d5d-83a2-48c1-8bfc-1ca543c3b86a None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:07.392879 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca108d5d-83a2-48c1-8bfc-1ca543c3b86a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:07.393733 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca108d5d-83a2-48c1-8bfc-1ca543c3b86a None admin] RBAC: Adding query filter params (role.id=478bbce5a7b34a23aabf38a0d1789a54, user.id=2878bd4ea618480aa6f4dad183d67f20, scope.system=all) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:07.394279 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca108d5d-83a2-48c1-8bfc-1ca543c3b86a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:07.395587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca108d5d-83a2-48c1-8bfc-1ca543c3b86a None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:07.415576 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 185/377] 10.222.0.49 () {56 vars in 1308 bytes} [Thu Jul 14 11:48:07 2022] GET /identity/v3/role_assignments?user.id=2878bd4ea618480aa6f4dad183d67f20&scope.system=all&role.id=478bbce5a7b34a23aabf38a0d1789a54 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:07.415576 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca108d5d-83a2-48c1-8bfc-1ca543c3b86a None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:07.425005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aae18c-e2e1-4357-80bd-3f3b353232f1 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:07.490010 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335a971-1255-41ee-b3ab-3ea724c255d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:07.491076 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335a971-1255-41ee-b3ab-3ea724c255d0 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:07.491591 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335a971-1255-41ee-b3ab-3ea724c255d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:07.492100 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335a971-1255-41ee-b3ab-3ea724c255d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:07.493035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:07.494968 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335a971-1255-41ee-b3ab-3ea724c255d0 None admin] RBAC: Adding query filter params (group.id=4b49cad6230245008593d306c76d5611, role.id=321ee52ce1bc4eafa201f23f55f23d2b, scope.project.id=98e8f9ea0c4446b68d2be9ca4901c939) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:07.495623 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335a971-1255-41ee-b3ab-3ea724c255d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:07.497741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335a971-1255-41ee-b3ab-3ea724c255d0 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:07.508978 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 193/378] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 14 11:48:07 2022] GET /identity/v3/role_assignments?group.id=4b49cad6230245008593d306c76d5611&scope.project.id=98e8f9ea0c4446b68d2be9ca4901c939&role.id=321ee52ce1bc4eafa201f23f55f23d2b => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:07.561859 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca108d5d-83a2-48c1-8bfc-1ca543c3b86a None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:07.602787 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f627d8-2802-4d5f-b67c-fe3894dc5529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:07.603582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f627d8-2802-4d5f-b67c-fe3894dc5529 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:07.604636 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f627d8-2802-4d5f-b67c-fe3894dc5529 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:07.605026 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f627d8-2802-4d5f-b67c-fe3894dc5529 None admin] PATH_INFO: `/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:07.606303 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f627d8-2802-4d5f-b67c-fe3894dc5529 None admin] RBAC: Authorizing `identity:get_group(group_id=cb0fe99fc83e4a8eab48a80f05e6994a)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:07.607775 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f627d8-2802-4d5f-b67c-fe3894dc5529 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:07.609872 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 186/379] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 14 11:48:07 2022] GET /identity/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:07.615633 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335a971-1255-41ee-b3ab-3ea724c255d0 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:07.669296 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:07.779022 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335a971-1255-41ee-b3ab-3ea724c255d0 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:07.834171 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75a7bf-df93-4ac0-94eb-b780e2d10aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:07.834859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75a7bf-df93-4ac0-94eb-b780e2d10aad None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:07.835145 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75a7bf-df93-4ac0-94eb-b780e2d10aad None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:07.835425 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75a7bf-df93-4ac0-94eb-b780e2d10aad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:07.836323 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75a7bf-df93-4ac0-94eb-b780e2d10aad None admin] RBAC: Adding query filter params (group.id=cb0fe99fc83e4a8eab48a80f05e6994a, role.id=703199a2f03143128fbac7cc8481b912, scope.project.id=3bab82494d694b8db2b6698451bdf404) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:07.836642 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75a7bf-df93-4ac0-94eb-b780e2d10aad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:07.838134 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75a7bf-df93-4ac0-94eb-b780e2d10aad None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:07.849168 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 194/380] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 14 11:48:07 2022] GET /identity/v3/role_assignments?group.id=cb0fe99fc83e4a8eab48a80f05e6994a&scope.project.id=3bab82494d694b8db2b6698451bdf404&role.id=703199a2f03143128fbac7cc8481b912 => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:08.009061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d8a21-ec2f-4f6a-9599-1d3e9c97212a None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:08.009229 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d8a21-ec2f-4f6a-9599-1d3e9c97212a None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:08.009513 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d8a21-ec2f-4f6a-9599-1d3e9c97212a None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:08.011877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 187/381] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:08.017664 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6677c-9c90-437d-8ddb-4e017d3da7c7 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:08.017971 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6677c-9c90-437d-8ddb-4e017d3da7c7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:08.018228 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6677c-9c90-437d-8ddb-4e017d3da7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:08.038740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-3dc6677c-9c90-437d-8ddb-4e017d3da7c7 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:08.039997 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3dc6677c-9c90-437d-8ddb-4e017d3da7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:08.132422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 195/382] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:08.158633 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d8a21-ec2f-4f6a-9599-1d3e9c97212a None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:08.316744 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d8a21-ec2f-4f6a-9599-1d3e9c97212a None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:08.345679 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:08.361809 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a6b43-c116-4f87-9a47-22fc0ac0c115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:08.362640 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a6b43-c116-4f87-9a47-22fc0ac0c115 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:08.362931 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a6b43-c116-4f87-9a47-22fc0ac0c115 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:08.363213 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a6b43-c116-4f87-9a47-22fc0ac0c115 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:08.383038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a6b43-c116-4f87-9a47-22fc0ac0c115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-e67a6b43-c116-4f87-9a47-22fc0ac0c115 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:08.391935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:08.392814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:08.393665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:08.393665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:08.393665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:08.393665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:08.393665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:08.393665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:08.393665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:08.393665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:08.393665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:08.393665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:08.393665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:48:08.393665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:08.398078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 188/383] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:48:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:08.399482 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6677c-9c90-437d-8ddb-4e017d3da7c7 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:08.421366 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:08.466115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70bda8-3be6-43e7-8a1a-0185fa58a157 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:08.466432 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70bda8-3be6-43e7-8a1a-0185fa58a157 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:08.466690 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70bda8-3be6-43e7-8a1a-0185fa58a157 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:08.468103 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 189/384] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:48:08.474914 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227a408-ad06-4f97-8945-e73104831c54 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:08.475195 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227a408-ad06-4f97-8945-e73104831c54 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:08.475556 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227a408-ad06-4f97-8945-e73104831c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:08.501448 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-6227a408-ad06-4f97-8945-e73104831c54 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:08.504661 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-6227a408-ad06-4f97-8945-e73104831c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:08.569309 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6677c-9c90-437d-8ddb-4e017d3da7c7 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:08.595532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 190/385] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:48:08.617546 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83910d-920f-496b-bf56-3dcb268bb8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:08.618569 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83910d-920f-496b-bf56-3dcb268bb8d6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:08.619046 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83910d-920f-496b-bf56-3dcb268bb8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:08.619525 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83910d-920f-496b-bf56-3dcb268bb8d6 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:08.620544 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83910d-920f-496b-bf56-3dcb268bb8d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:08.621139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83910d-920f-496b-bf56-3dcb268bb8d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:08.622717 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83910d-920f-496b-bf56-3dcb268bb8d6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:08.631430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 196/386] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:08.637586 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227a408-ad06-4f97-8945-e73104831c54 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:08.645573 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83910d-920f-496b-bf56-3dcb268bb8d6 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:08.795690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:08.818828 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83910d-920f-496b-bf56-3dcb268bb8d6 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:08.841559 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227a408-ad06-4f97-8945-e73104831c54 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:08.860280 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430c01b-ab5d-4012-af6a-061e90e60180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:08.861563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430c01b-ab5d-4012-af6a-061e90e60180 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:08.862511 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430c01b-ab5d-4012-af6a-061e90e60180 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:08.863019 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430c01b-ab5d-4012-af6a-061e90e60180 None admin] PATH_INFO: `/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:08.864827 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430c01b-ab5d-4012-af6a-061e90e60180 None admin] RBAC: Authorizing `identity:get_group(group_id=cb0fe99fc83e4a8eab48a80f05e6994a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:08.866518 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430c01b-ab5d-4012-af6a-061e90e60180 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:08.868438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 197/387] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 14 11:48:08 2022] GET /identity/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:08.873522 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:08.877050 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430c01b-ab5d-4012-af6a-061e90e60180 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:08.914141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267045ab-dece-47a6-96c3-882b55197663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:08.915260 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267045ab-dece-47a6-96c3-882b55197663 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:08.915686 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267045ab-dece-47a6-96c3-882b55197663 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:08.916123 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267045ab-dece-47a6-96c3-882b55197663 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:08.932135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267045ab-dece-47a6-96c3-882b55197663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-267045ab-dece-47a6-96c3-882b55197663 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:08.944402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:08.945449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:08.946384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:08.946384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:08.946384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:08.946384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:08.946384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:08.946384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:08.946384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:08.946384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:08.946384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:08.946384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:08.946384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:48:08.946384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:08.948871 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 191/388] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:08.970281 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267045ab-dece-47a6-96c3-882b55197663 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:08.999100 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430c01b-ab5d-4012-af6a-061e90e60180 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:09.060433 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61387e10-0a9c-4436-af92-37bce469675b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:09.061422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61387e10-0a9c-4436-af92-37bce469675b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:09.061817 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61387e10-0a9c-4436-af92-37bce469675b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:09.062107 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61387e10-0a9c-4436-af92-37bce469675b None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:09.065649 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61387e10-0a9c-4436-af92-37bce469675b None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:09.067256 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61387e10-0a9c-4436-af92-37bce469675b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:09.069316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 198/389] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:48:08 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:09.075836 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61387e10-0a9c-4436-af92-37bce469675b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:09.103879 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267045ab-dece-47a6-96c3-882b55197663 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:09.105345 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:09.146067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47008c9f-a160-497d-8053-df6658002e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:09.146742 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47008c9f-a160-497d-8053-df6658002e8a None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:09.147026 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47008c9f-a160-497d-8053-df6658002e8a None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:09.147308 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47008c9f-a160-497d-8053-df6658002e8a None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:09.148133 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47008c9f-a160-497d-8053-df6658002e8a None admin] RBAC: Adding query filter params (name=member) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:09.148491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47008c9f-a160-497d-8053-df6658002e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:09.150005 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47008c9f-a160-497d-8053-df6658002e8a None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:09.159808 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 192/390] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:48:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:09.166810 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47008c9f-a160-497d-8053-df6658002e8a None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:09.235812 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:09.277952 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61387e10-0a9c-4436-af92-37bce469675b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:09.333663 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47008c9f-a160-497d-8053-df6658002e8a None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:09.349624 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185349-80d0-40d0-a0ae-ac27b1a1632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:09.350517 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185349-80d0-40d0-a0ae-ac27b1a1632b None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:09.350807 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185349-80d0-40d0-a0ae-ac27b1a1632b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:09.351120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185349-80d0-40d0-a0ae-ac27b1a1632b None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172/groups/cb0fe99fc83e4a8eab48a80f05e6994a/roles/703199a2f03143128fbac7cc8481b912` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:09.358751 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74185349-80d0-40d0-a0ae-ac27b1a1632b None admin] RBAC: Authorizing `identity:create_grant(project_id=d9040b944c534111b0b4718481683172, group_id=cb0fe99fc83e4a8eab48a80f05e6994a, role_id=703199a2f03143128fbac7cc8481b912)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:09.360279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74185349-80d0-40d0-a0ae-ac27b1a1632b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:09.370343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8e17c-de74-4b76-b66f-6ceefb1fd4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:09.372421 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8e17c-de74-4b76-b66f-6ceefb1fd4dd None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:09.372970 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8e17c-de74-4b76-b66f-6ceefb1fd4dd None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:09.373394 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8e17c-de74-4b76-b66f-6ceefb1fd4dd None admin] PATH_INFO: `/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:09.374714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8e17c-de74-4b76-b66f-6ceefb1fd4dd None admin] RBAC: Authorizing `identity:get_group(group_id=cb0fe99fc83e4a8eab48a80f05e6994a)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:09.376380 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8e17c-de74-4b76-b66f-6ceefb1fd4dd None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:09.378454 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 193/391] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 14 11:48:09 2022] GET /identity/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:09.383950 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8e17c-de74-4b76-b66f-6ceefb1fd4dd None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:09.402237 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 199/392] 10.222.0.49 () {58 vars in 1442 bytes} [Thu Jul 14 11:48:09 2022] PUT /identity/v3/projects/d9040b944c534111b0b4718481683172/groups/cb0fe99fc83e4a8eab48a80f05e6994a/roles/703199a2f03143128fbac7cc8481b912 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:48:09.531967 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8e17c-de74-4b76-b66f-6ceefb1fd4dd None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:09.534139 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:09.572374 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddc2b6-61d3-49b1-b4f5-d25bf601ad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:09.573267 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddc2b6-61d3-49b1-b4f5-d25bf601ad3c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:09.573556 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddc2b6-61d3-49b1-b4f5-d25bf601ad3c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:09.573838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddc2b6-61d3-49b1-b4f5-d25bf601ad3c None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:09.575388 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddc2b6-61d3-49b1-b4f5-d25bf601ad3c None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:09.577098 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddc2b6-61d3-49b1-b4f5-d25bf601ad3c None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:09.579367 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 194/393] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:48:09 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:09.585191 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185349-80d0-40d0-a0ae-ac27b1a1632b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:09.670829 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:09.696029 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185349-80d0-40d0-a0ae-ac27b1a1632b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:09.734987 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b7c38-fc46-4275-8550-c223aff9a994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:09.736291 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b7c38-fc46-4275-8550-c223aff9a994 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:09.736828 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b7c38-fc46-4275-8550-c223aff9a994 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:09.737252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b7c38-fc46-4275-8550-c223aff9a994 None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172/groups/cb0fe99fc83e4a8eab48a80f05e6994a/roles/7b517960be1c437d850537c7e0aa985a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:09.739920 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b7c38-fc46-4275-8550-c223aff9a994 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9040b944c534111b0b4718481683172, group_id=cb0fe99fc83e4a8eab48a80f05e6994a, role_id=7b517960be1c437d850537c7e0aa985a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:09.741550 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b7c38-fc46-4275-8550-c223aff9a994 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:09.781108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 200/394] 10.222.0.49 () {58 vars in 1442 bytes} [Thu Jul 14 11:48:09 2022] PUT /identity/v3/projects/d9040b944c534111b0b4718481683172/groups/cb0fe99fc83e4a8eab48a80f05e6994a/roles/7b517960be1c437d850537c7e0aa985a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:48:10.660141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dafd6-fce3-4b46-bc66-6195fcfcbe7f None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:10.660669 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dafd6-fce3-4b46-bc66-6195fcfcbe7f None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:10.660752 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dafd6-fce3-4b46-bc66-6195fcfcbe7f None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:10.662338 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 195/395] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:10.673776 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6f08b-4c58-4dae-b508-502f603a64df None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:10.674593 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6f08b-4c58-4dae-b508-502f603a64df None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:10.675020 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6f08b-4c58-4dae-b508-502f603a64df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:10.697900 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-d8b6f08b-4c58-4dae-b508-502f603a64df None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:10.699375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d8b6f08b-4c58-4dae-b508-502f603a64df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:10.725440 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83777451-5f64-4207-81f8-f992255c1b42 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:10.726070 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83777451-5f64-4207-81f8-f992255c1b42 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:10.726546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83777451-5f64-4207-81f8-f992255c1b42 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:10.728524 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 196/396] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:10.733969 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd504bf7-4fb2-4815-9b0c-7b53496cd8b3 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:10.734539 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd504bf7-4fb2-4815-9b0c-7b53496cd8b3 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:10.735017 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd504bf7-4fb2-4815-9b0c-7b53496cd8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:10.767636 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-fd504bf7-4fb2-4815-9b0c-7b53496cd8b3 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:10.770887 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-fd504bf7-4fb2-4815-9b0c-7b53496cd8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:10.817816 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 201/397] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:10.858131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6f08b-4c58-4dae-b508-502f603a64df None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:10.882901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 197/398] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:10.918547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd504bf7-4fb2-4815-9b0c-7b53496cd8b3 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:10.954733 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:11.003522 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6f08b-4c58-4dae-b508-502f603a64df None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:11.046856 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:11.048625 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837f1ff-764e-41ce-9f61-b3da48795a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:11.049454 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837f1ff-764e-41ce-9f61-b3da48795a6a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:11.049744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837f1ff-764e-41ce-9f61-b3da48795a6a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:11.050026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837f1ff-764e-41ce-9f61-b3da48795a6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:11.051227 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd504bf7-4fb2-4815-9b0c-7b53496cd8b3 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:11.063162 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837f1ff-764e-41ce-9f61-b3da48795a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-6837f1ff-764e-41ce-9f61-b3da48795a6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:11.073132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:11.074026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:11.074838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:11.074838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:11.074838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:11.074838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:11.074838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:11.074838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:11.074838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:11.074838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:11.074838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:11.074838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:11.074838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:48:11.074838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:11.074838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 202/399] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:11.081150 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33df4f-c27d-4407-ae4f-816b1814b144 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:11.081439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33df4f-c27d-4407-ae4f-816b1814b144 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:11.081715 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33df4f-c27d-4407-ae4f-816b1814b144 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:11.083151 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 203/400] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:11.083931 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33df4f-c27d-4407-ae4f-816b1814b144 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:11.102170 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2239fc-8000-4579-9b81-a8c3c7814c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:11.102874 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2239fc-8000-4579-9b81-a8c3c7814c2d None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:11.103157 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2239fc-8000-4579-9b81-a8c3c7814c2d None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:11.103485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2239fc-8000-4579-9b81-a8c3c7814c2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:11.114779 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2239fc-8000-4579-9b81-a8c3c7814c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-ef2239fc-8000-4579-9b81-a8c3c7814c2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:11.122631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:11.123569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:11.124391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:11.124391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:11.124391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:11.124391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:11.124391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:11.124391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:11.124391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:11.124391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:11.124391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:11.124391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:11.124391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:48:11.124391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:11.130420 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 198/401] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:48:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:11.130420 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88edd39-292b-4883-8299-e75fa9abfdcb None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:11.130420 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88edd39-292b-4883-8299-e75fa9abfdcb None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:11.130420 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88edd39-292b-4883-8299-e75fa9abfdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:11.145944 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-b88edd39-292b-4883-8299-e75fa9abfdcb None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:11.147128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-b88edd39-292b-4883-8299-e75fa9abfdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:11.231944 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 199/402] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:11.231944 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88edd39-292b-4883-8299-e75fa9abfdcb None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:11.260224 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33df4f-c27d-4407-ae4f-816b1814b144 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:11.292804 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:11.302684 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cedab1-c26c-4a59-98f2-c480a4916171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:11.303390 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cedab1-c26c-4a59-98f2-c480a4916171 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:11.303678 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cedab1-c26c-4a59-98f2-c480a4916171 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:11.304047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cedab1-c26c-4a59-98f2-c480a4916171 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:11.304814 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cedab1-c26c-4a59-98f2-c480a4916171 None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:11.305110 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cedab1-c26c-4a59-98f2-c480a4916171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:11.306562 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cedab1-c26c-4a59-98f2-c480a4916171 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:11.316384 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 204/403] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:48:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:11.317340 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cedab1-c26c-4a59-98f2-c480a4916171 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:11.347535 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:11.358545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88edd39-292b-4883-8299-e75fa9abfdcb None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:11.404048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c363d-b62a-4a64-9520-71cf70cb940d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:11.405203 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c363d-b62a-4a64-9520-71cf70cb940d None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:11.405498 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c363d-b62a-4a64-9520-71cf70cb940d None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:11.405804 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c363d-b62a-4a64-9520-71cf70cb940d None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:11.406876 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c363d-b62a-4a64-9520-71cf70cb940d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:11.407195 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c363d-b62a-4a64-9520-71cf70cb940d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:11.408917 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c363d-b62a-4a64-9520-71cf70cb940d None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:11.421550 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 200/404] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:11.422423 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c363d-b62a-4a64-9520-71cf70cb940d None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:11.433808 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cedab1-c26c-4a59-98f2-c480a4916171 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:11.485832 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec29f6-7b0e-4330-9920-b703626acdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:11.487275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec29f6-7b0e-4330-9920-b703626acdc3 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:11.488039 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec29f6-7b0e-4330-9920-b703626acdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:11.488559 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec29f6-7b0e-4330-9920-b703626acdc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:11.503799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec29f6-7b0e-4330-9920-b703626acdc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-40ec29f6-7b0e-4330-9920-b703626acdc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:11.514528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:11.515407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:11.516192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:11.516192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:11.516192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:11.516192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:11.516192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:11.516192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:11.516192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:11.516192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:11.516192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:11.516192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:11.516192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:48:11.516192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:11.519173 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 205/405] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:48:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:11.520206 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec29f6-7b0e-4330-9920-b703626acdc3 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:11.554327 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c363d-b62a-4a64-9520-71cf70cb940d None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:11.575361 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:11.600005 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e727c18-94a1-4bab-958e-8eb2fcfa6b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:11.601095 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e727c18-94a1-4bab-958e-8eb2fcfa6b8e None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:11.601629 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e727c18-94a1-4bab-958e-8eb2fcfa6b8e None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:11.602016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e727c18-94a1-4bab-958e-8eb2fcfa6b8e None admin] PATH_INFO: `/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:11.604285 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e727c18-94a1-4bab-958e-8eb2fcfa6b8e None admin] RBAC: Authorizing `identity:get_group(group_id=cb0fe99fc83e4a8eab48a80f05e6994a)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:11.605297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e727c18-94a1-4bab-958e-8eb2fcfa6b8e None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:11.612396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 201/406] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 14 11:48:11 2022] GET /identity/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:11.613602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e727c18-94a1-4bab-958e-8eb2fcfa6b8e None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:11.641218 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec29f6-7b0e-4330-9920-b703626acdc3 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:11.646747 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:11.681579 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d871667-8fec-4d6c-868f-586d3a6329ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:11.682612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d871667-8fec-4d6c-868f-586d3a6329ca None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:11.683182 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d871667-8fec-4d6c-868f-586d3a6329ca None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:11.683679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d871667-8fec-4d6c-868f-586d3a6329ca None admin] PATH_INFO: `/v3/groups/4b49cad6230245008593d306c76d5611` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:11.685179 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d871667-8fec-4d6c-868f-586d3a6329ca None admin] RBAC: Authorizing `identity:get_group(group_id=4b49cad6230245008593d306c76d5611)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:11.686931 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d871667-8fec-4d6c-868f-586d3a6329ca None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:11.688803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 206/407] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 14 11:48:11 2022] GET /identity/v3/groups/4b49cad6230245008593d306c76d5611 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:11.689936 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d871667-8fec-4d6c-868f-586d3a6329ca None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:11.753772 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e727c18-94a1-4bab-958e-8eb2fcfa6b8e None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:11.798260 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d40e2-7dd0-4a38-9e12-b509a23f821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:11.799255 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d40e2-7dd0-4a38-9e12-b509a23f821a None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:11.799555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d40e2-7dd0-4a38-9e12-b509a23f821a None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:11.799838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d40e2-7dd0-4a38-9e12-b509a23f821a None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:11.800890 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d40e2-7dd0-4a38-9e12-b509a23f821a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:11.801207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d40e2-7dd0-4a38-9e12-b509a23f821a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:11.802581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d40e2-7dd0-4a38-9e12-b509a23f821a None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:11.803150 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d871667-8fec-4d6c-868f-586d3a6329ca None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:11.817642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 202/408] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:11.817642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d40e2-7dd0-4a38-9e12-b509a23f821a None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:11.826988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:11.852017 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf7f2d-80a6-494a-80ba-4f690b0faa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:11.853130 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf7f2d-80a6-494a-80ba-4f690b0faa92 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:11.853420 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf7f2d-80a6-494a-80ba-4f690b0faa92 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:11.853698 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf7f2d-80a6-494a-80ba-4f690b0faa92 None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:11.855488 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf7f2d-80a6-494a-80ba-4f690b0faa92 None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:11.856975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf7f2d-80a6-494a-80ba-4f690b0faa92 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:11.860287 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 207/409] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:48:11 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:11.862091 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf7f2d-80a6-494a-80ba-4f690b0faa92 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:11.914848 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:11.937134 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d40e2-7dd0-4a38-9e12-b509a23f821a None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:11.985699 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7363705-9cda-4804-8709-3b4cc319f2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:11.987673 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7363705-9cda-4804-8709-3b4cc319f2f1 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:11.988204 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7363705-9cda-4804-8709-3b4cc319f2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:11.989036 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7363705-9cda-4804-8709-3b4cc319f2f1 None admin] PATH_INFO: `/v3/projects/98e8f9ea0c4446b68d2be9ca4901c939` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:11.990899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7363705-9cda-4804-8709-3b4cc319f2f1 None admin] RBAC: Authorizing `identity:get_project(project_id=98e8f9ea0c4446b68d2be9ca4901c939)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:11.993655 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7363705-9cda-4804-8709-3b4cc319f2f1 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:11.997018 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 203/410] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:48:11 2022] GET /identity/v3/projects/98e8f9ea0c4446b68d2be9ca4901c939 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:11.998671 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7363705-9cda-4804-8709-3b4cc319f2f1 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:12.001990 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf7f2d-80a6-494a-80ba-4f690b0faa92 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:12.042349 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf50e4-1f01-4d06-a0db-4fe85cc65f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:12.043459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf50e4-1f01-4d06-a0db-4fe85cc65f65 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:12.043816 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf50e4-1f01-4d06-a0db-4fe85cc65f65 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:12.044245 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf50e4-1f01-4d06-a0db-4fe85cc65f65 None admin] PATH_INFO: `/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:12.045814 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf50e4-1f01-4d06-a0db-4fe85cc65f65 None admin] RBAC: Authorizing `identity:get_group(group_id=cb0fe99fc83e4a8eab48a80f05e6994a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:12.048039 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf50e4-1f01-4d06-a0db-4fe85cc65f65 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:12.049679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 208/411] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 14 11:48:11 2022] GET /identity/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:12.054966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf50e4-1f01-4d06-a0db-4fe85cc65f65 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:12.118421 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:12.150782 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7363705-9cda-4804-8709-3b4cc319f2f1 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:12.178917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf50e4-1f01-4d06-a0db-4fe85cc65f65 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:12.194610 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0046f4-f066-4a6e-996b-7636603bca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:12.195517 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0046f4-f066-4a6e-996b-7636603bca5b None admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:12.195712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0046f4-f066-4a6e-996b-7636603bca5b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:12.196038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0046f4-f066-4a6e-996b-7636603bca5b None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404/groups/cb0fe99fc83e4a8eab48a80f05e6994a/roles/7b517960be1c437d850537c7e0aa985a` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:12.198049 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0046f4-f066-4a6e-996b-7636603bca5b None admin] RBAC: Authorizing `identity:create_grant(project_id=3bab82494d694b8db2b6698451bdf404, group_id=cb0fe99fc83e4a8eab48a80f05e6994a, role_id=7b517960be1c437d850537c7e0aa985a)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:12.199508 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0046f4-f066-4a6e-996b-7636603bca5b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:12.223915 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 204/412] 10.222.0.49 () {58 vars in 1442 bytes} [Thu Jul 14 11:48:11 2022] PUT /identity/v3/projects/3bab82494d694b8db2b6698451bdf404/groups/cb0fe99fc83e4a8eab48a80f05e6994a/roles/7b517960be1c437d850537c7e0aa985a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:48:12.223915 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0046f4-f066-4a6e-996b-7636603bca5b None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:12.226420 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c516eb-40c6-4d5b-be62-6135716c9200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:12.227327 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c516eb-40c6-4d5b-be62-6135716c9200 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:12.227617 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c516eb-40c6-4d5b-be62-6135716c9200 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:12.227919 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c516eb-40c6-4d5b-be62-6135716c9200 None admin] PATH_INFO: `/v3/projects/98e8f9ea0c4446b68d2be9ca4901c939/groups/4b49cad6230245008593d306c76d5611/roles/321ee52ce1bc4eafa201f23f55f23d2b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:12.230179 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c516eb-40c6-4d5b-be62-6135716c9200 None admin] RBAC: Authorizing `identity:create_grant(project_id=98e8f9ea0c4446b68d2be9ca4901c939, group_id=4b49cad6230245008593d306c76d5611, role_id=321ee52ce1bc4eafa201f23f55f23d2b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:12.231784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c516eb-40c6-4d5b-be62-6135716c9200 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:12.240077 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:12.258124 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 209/413] 10.222.0.49 () {58 vars in 1442 bytes} [Thu Jul 14 11:48:12 2022] PUT /identity/v3/projects/98e8f9ea0c4446b68d2be9ca4901c939/groups/4b49cad6230245008593d306c76d5611/roles/321ee52ce1bc4eafa201f23f55f23d2b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:48:12.260586 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44ec41-fc60-4452-a663-d7820d8c3859 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:12.261069 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44ec41-fc60-4452-a663-d7820d8c3859 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:12.261510 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44ec41-fc60-4452-a663-d7820d8c3859 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:12.268292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 210/414] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:12.273794 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab05fbe-5322-4f67-a9e0-2b56c7e44711 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:12.274108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab05fbe-5322-4f67-a9e0-2b56c7e44711 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:12.274368 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab05fbe-5322-4f67-a9e0-2b56c7e44711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:12.308632 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-6ab05fbe-5322-4f67-a9e0-2b56c7e44711 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:12.319172 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6ab05fbe-5322-4f67-a9e0-2b56c7e44711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:12.459209 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0046f4-f066-4a6e-996b-7636603bca5b None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:12.470347 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 211/415] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:12.495655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab05fbe-5322-4f67-a9e0-2b56c7e44711 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:12.515308 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27191a50-cd0a-415e-8fe7-9f54f2c9f49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:12.517974 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27191a50-cd0a-415e-8fe7-9f54f2c9f49c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:12.518266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27191a50-cd0a-415e-8fe7-9f54f2c9f49c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:12.519464 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27191a50-cd0a-415e-8fe7-9f54f2c9f49c None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:12.521784 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27191a50-cd0a-415e-8fe7-9f54f2c9f49c None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:12.523270 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27191a50-cd0a-415e-8fe7-9f54f2c9f49c None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:12.525220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 205/416] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:48:12 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:12.529135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f69d0a-a995-43c0-a89a-8b359084ce88 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:12.529433 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f69d0a-a995-43c0-a89a-8b359084ce88 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:12.529714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f69d0a-a995-43c0-a89a-8b359084ce88 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:12.531106 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 206/417] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:48:12.536438 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803094e-8763-40b2-b222-cc1c1c6cb9cb None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:12.536731 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803094e-8763-40b2-b222-cc1c1c6cb9cb None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:12.537276 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803094e-8763-40b2-b222-cc1c1c6cb9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:12.555364 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-d803094e-8763-40b2-b222-cc1c1c6cb9cb None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:12.556604 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-d803094e-8763-40b2-b222-cc1c1c6cb9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:12.578484 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:12.638772 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 207/418] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:48:12.639390 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803094e-8763-40b2-b222-cc1c1c6cb9cb None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:12.660323 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab05fbe-5322-4f67-a9e0-2b56c7e44711 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:12.665406 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:12.712605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752562d-ec7c-4c83-a876-4ddcbf54c5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:12.714382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752562d-ec7c-4c83-a876-4ddcbf54c5d7 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:12.715480 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752562d-ec7c-4c83-a876-4ddcbf54c5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:12.716003 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752562d-ec7c-4c83-a876-4ddcbf54c5d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:12.733286 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752562d-ec7c-4c83-a876-4ddcbf54c5d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-9752562d-ec7c-4c83-a876-4ddcbf54c5d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:12.745373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:12.746293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:12.747061 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:12.747061 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:12.747061 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:12.747061 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:12.747061 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:12.747061 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:12.747061 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:12.747061 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:12.747061 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:12.747061 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:12.747061 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:48:12.747061 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:12.751262 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 212/419] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:48:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:12.752453 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752562d-ec7c-4c83-a876-4ddcbf54c5d7 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:12.792885 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803094e-8763-40b2-b222-cc1c1c6cb9cb None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:12.844720 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3732e82-0adc-4733-8591-67992ba8a67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:12.846095 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3732e82-0adc-4733-8591-67992ba8a67f None admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:12.846617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3732e82-0adc-4733-8591-67992ba8a67f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:12.847055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3732e82-0adc-4733-8591-67992ba8a67f None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404/groups/cb0fe99fc83e4a8eab48a80f05e6994a/roles/703199a2f03143128fbac7cc8481b912` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:12.850220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3732e82-0adc-4733-8591-67992ba8a67f None admin] RBAC: Authorizing `identity:create_grant(project_id=3bab82494d694b8db2b6698451bdf404, group_id=cb0fe99fc83e4a8eab48a80f05e6994a, role_id=703199a2f03143128fbac7cc8481b912)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:12.852303 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3732e82-0adc-4733-8591-67992ba8a67f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:12.872671 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 208/420] 10.222.0.49 () {58 vars in 1442 bytes} [Thu Jul 14 11:48:12 2022] PUT /identity/v3/projects/3bab82494d694b8db2b6698451bdf404/groups/cb0fe99fc83e4a8eab48a80f05e6994a/roles/703199a2f03143128fbac7cc8481b912 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:48:12.876336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3732e82-0adc-4733-8591-67992ba8a67f None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:12.887412 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752562d-ec7c-4c83-a876-4ddcbf54c5d7 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:12.904289 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:12.932712 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666cb50-56ac-48d5-9efa-34f988adced5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:12.933775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666cb50-56ac-48d5-9efa-34f988adced5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:12.934303 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666cb50-56ac-48d5-9efa-34f988adced5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:12.934800 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666cb50-56ac-48d5-9efa-34f988adced5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:12.947741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666cb50-56ac-48d5-9efa-34f988adced5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-0666cb50-56ac-48d5-9efa-34f988adced5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:12.956727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:12.957741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:12.958709 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:12.958709 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:12.958709 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:12.958709 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:12.958709 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:12.958709 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:12.958709 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:12.958709 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:12.958709 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:12.958709 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:12.958709 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:48:12.958709 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:12.961178 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 213/421] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:12.973104 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666cb50-56ac-48d5-9efa-34f988adced5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:12.976369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:13.011679 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3732e82-0adc-4733-8591-67992ba8a67f None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:13.092962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55ab10-1ee2-4b6e-88d7-7d37323ccd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:13.093841 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55ab10-1ee2-4b6e-88d7-7d37323ccd3c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:13.094128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55ab10-1ee2-4b6e-88d7-7d37323ccd3c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:13.094580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55ab10-1ee2-4b6e-88d7-7d37323ccd3c None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:13.096210 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55ab10-1ee2-4b6e-88d7-7d37323ccd3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:13.096523 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55ab10-1ee2-4b6e-88d7-7d37323ccd3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:13.097975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55ab10-1ee2-4b6e-88d7-7d37323ccd3c None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:13.116694 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 209/422] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:13.122482 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55ab10-1ee2-4b6e-88d7-7d37323ccd3c None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:13.180436 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666cb50-56ac-48d5-9efa-34f988adced5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:13.238682 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa3bdf-13b8-41cf-a225-3597261e3ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:13.240519 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa3bdf-13b8-41cf-a225-3597261e3ac3 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:13.241170 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa3bdf-13b8-41cf-a225-3597261e3ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:13.243142 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa3bdf-13b8-41cf-a225-3597261e3ac3 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:13.244158 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa3bdf-13b8-41cf-a225-3597261e3ac3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:13.244682 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa3bdf-13b8-41cf-a225-3597261e3ac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:13.247182 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa3bdf-13b8-41cf-a225-3597261e3ac3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:13.265103 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 214/423] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:48:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:13.270207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa3bdf-13b8-41cf-a225-3597261e3ac3 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:13.285726 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55ab10-1ee2-4b6e-88d7-7d37323ccd3c None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:13.320248 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:13.343486 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:13.351221 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb8375-c511-4e15-824d-37769472e21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:13.351890 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8375-c511-4e15-824d-37769472e21f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:13.352187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8375-c511-4e15-824d-37769472e21f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:13.352473 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8375-c511-4e15-824d-37769472e21f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:13.444533 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa3bdf-13b8-41cf-a225-3597261e3ac3 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:13.483929 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb8375-c511-4e15-824d-37769472e21f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:13.483929 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb8375-c511-4e15-824d-37769472e21f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:13.493683 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842af5ba-4893-438e-92f8-5c0f55afff44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:13.494765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842af5ba-4893-438e-92f8-5c0f55afff44 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:13.495317 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842af5ba-4893-438e-92f8-5c0f55afff44 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:13.495925 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842af5ba-4893-438e-92f8-5c0f55afff44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:13.576860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842af5ba-4893-438e-92f8-5c0f55afff44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:13.578792 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842af5ba-4893-438e-92f8-5c0f55afff44 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:13.592331 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 210/424] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:13.598733 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb8375-c511-4e15-824d-37769472e21f None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:13.607660 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:13.643475 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:13.738092 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 215/425] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:13.744136 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842af5ba-4893-438e-92f8-5c0f55afff44 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:13.789282 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb8375-c511-4e15-824d-37769472e21f None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:13.853999 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cadd3-8938-47e4-868f-d43841f10eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:13.854856 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cadd3-8938-47e4-868f-d43841f10eee None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:13.855141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cadd3-8938-47e4-868f-d43841f10eee None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:13.855416 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cadd3-8938-47e4-868f-d43841f10eee None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:13.856728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cadd3-8938-47e4-868f-d43841f10eee None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:13.858175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cadd3-8938-47e4-868f-d43841f10eee None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:13.863468 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 211/426] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:48:13 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:13.866989 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cadd3-8938-47e4-868f-d43841f10eee None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:13.945005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842af5ba-4893-438e-92f8-5c0f55afff44 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:13.995910 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:13.996239 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:14.005590 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cadd3-8938-47e4-868f-d43841f10eee None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:14.019455 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45b3db-4c79-4b24-a840-20f49c8d12fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:14.020347 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45b3db-4c79-4b24-a840-20f49c8d12fc None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:14.020640 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45b3db-4c79-4b24-a840-20f49c8d12fc None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:14.020916 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45b3db-4c79-4b24-a840-20f49c8d12fc None admin] PATH_INFO: `/v3/projects/d9040b944c534111b0b4718481683172` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:14.023959 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45b3db-4c79-4b24-a840-20f49c8d12fc None admin] RBAC: Authorizing `identity:get_project(project_id=d9040b944c534111b0b4718481683172)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:14.025513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45b3db-4c79-4b24-a840-20f49c8d12fc None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:14.027196 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 216/427] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:48:13 2022] GET /identity/v3/projects/d9040b944c534111b0b4718481683172 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:14.032602 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45b3db-4c79-4b24-a840-20f49c8d12fc None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:14.078208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743956e5-99b7-498b-a01b-a3582798daec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:14.079074 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743956e5-99b7-498b-a01b-a3582798daec None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:14.079358 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743956e5-99b7-498b-a01b-a3582798daec None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:14.079636 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743956e5-99b7-498b-a01b-a3582798daec None admin] PATH_INFO: `/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:14.083936 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743956e5-99b7-498b-a01b-a3582798daec None admin] RBAC: Authorizing `identity:get_group(group_id=cb0fe99fc83e4a8eab48a80f05e6994a)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:14.085645 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743956e5-99b7-498b-a01b-a3582798daec None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:14.097826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 212/428] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 14 11:48:13 2022] GET /identity/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:14.109221 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743956e5-99b7-498b-a01b-a3582798daec None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:14.256619 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45b3db-4c79-4b24-a840-20f49c8d12fc None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:14.301514 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743956e5-99b7-498b-a01b-a3582798daec None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:14.336029 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf9446-02d4-4c6a-9c9e-ee42bf387377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:14.336904 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf9446-02d4-4c6a-9c9e-ee42bf387377 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:14.337192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf9446-02d4-4c6a-9c9e-ee42bf387377 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:14.337472 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf9446-02d4-4c6a-9c9e-ee42bf387377 None admin] PATH_INFO: `/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:14.341053 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf9446-02d4-4c6a-9c9e-ee42bf387377 None admin] RBAC: Authorizing `identity:get_group(group_id=cb0fe99fc83e4a8eab48a80f05e6994a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:14.342518 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf9446-02d4-4c6a-9c9e-ee42bf387377 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:14.349561 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 217/429] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 14 11:48:14 2022] GET /identity/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a => generated 226 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:14.355234 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf9446-02d4-4c6a-9c9e-ee42bf387377 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:14.380712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dd95c-43f0-479d-ab97-51d76ad12afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:14.381383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dd95c-43f0-479d-ab97-51d76ad12afa None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:14.381672 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dd95c-43f0-479d-ab97-51d76ad12afa None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:14.381956 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dd95c-43f0-479d-ab97-51d76ad12afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:14.382789 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2dd95c-43f0-479d-ab97-51d76ad12afa None admin] RBAC: Adding query filter params (group.id=cb0fe99fc83e4a8eab48a80f05e6994a, role.id=703199a2f03143128fbac7cc8481b912, scope.project.id=d9040b944c534111b0b4718481683172) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:14.383106 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2dd95c-43f0-479d-ab97-51d76ad12afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:14.384579 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2dd95c-43f0-479d-ab97-51d76ad12afa None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:14.408096 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 213/430] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 14 11:48:14 2022] GET /identity/v3/role_assignments?group.id=cb0fe99fc83e4a8eab48a80f05e6994a&scope.project.id=d9040b944c534111b0b4718481683172&role.id=703199a2f03143128fbac7cc8481b912 => generated 611 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:14.496874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:14.513932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf9446-02d4-4c6a-9c9e-ee42bf387377 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:14.565819 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4867f-5f78-4ac3-8998-4072cf103562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:14.566487 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4867f-5f78-4ac3-8998-4072cf103562 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:14.566772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4867f-5f78-4ac3-8998-4072cf103562 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:14.567053 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4867f-5f78-4ac3-8998-4072cf103562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:14.567886 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4867f-5f78-4ac3-8998-4072cf103562 None admin] RBAC: Adding query filter params (group.id=cb0fe99fc83e4a8eab48a80f05e6994a, role.id=7b517960be1c437d850537c7e0aa985a, scope.project.id=d9040b944c534111b0b4718481683172) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:14.568226 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4867f-5f78-4ac3-8998-4072cf103562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:14.569671 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4867f-5f78-4ac3-8998-4072cf103562 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:14.580058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 218/431] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 14 11:48:14 2022] GET /identity/v3/role_assignments?group.id=cb0fe99fc83e4a8eab48a80f05e6994a&scope.project.id=d9040b944c534111b0b4718481683172&role.id=7b517960be1c437d850537c7e0aa985a => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:14.805593 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eed92-20e2-4382-8028-e6317d1dfda8 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:14.805928 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eed92-20e2-4382-8028-e6317d1dfda8 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:14.806099 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eed92-20e2-4382-8028-e6317d1dfda8 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:14.807779 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 214/432] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:14.813505 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b7ae0-a4f5-4679-bfd9-9586e3a26e93 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:14.813970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b7ae0-a4f5-4679-bfd9-9586e3a26e93 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:14.814118 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b7ae0-a4f5-4679-bfd9-9586e3a26e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:14.837608 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-4d5b7ae0-a4f5-4679-bfd9-9586e3a26e93 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:14.838826 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4d5b7ae0-a4f5-4679-bfd9-9586e3a26e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:14.919839 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 219/433] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:14.945856 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eed92-20e2-4382-8028-e6317d1dfda8 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:14.983238 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:15.062022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eed92-20e2-4382-8028-e6317d1dfda8 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:15.098063 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070f801-bd8c-454e-8a84-e3c9072aa645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:15.099105 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070f801-bd8c-454e-8a84-e3c9072aa645 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:15.099589 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070f801-bd8c-454e-8a84-e3c9072aa645 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:15.100054 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070f801-bd8c-454e-8a84-e3c9072aa645 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:15.100295 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28216ef-e4e1-4768-b72d-2ddfd0aa00d0 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:15.100698 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28216ef-e4e1-4768-b72d-2ddfd0aa00d0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:15.101068 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28216ef-e4e1-4768-b72d-2ddfd0aa00d0 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:15.103083 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 220/434] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:15.108100 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6364d5c-8fc8-44da-bb59-332cdc38c2ec None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:15.108412 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6364d5c-8fc8-44da-bb59-332cdc38c2ec None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:15.108695 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6364d5c-8fc8-44da-bb59-332cdc38c2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:15.114555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070f801-bd8c-454e-8a84-e3c9072aa645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-d070f801-bd8c-454e-8a84-e3c9072aa645 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:15.124426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:15.125342 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:15.126266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:15.126266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:15.126266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:15.126266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:15.126266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:15.126266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:15.126266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:15.126266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:15.126266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:15.126266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:15.126266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:48:15.126266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:15.126266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 215/435] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:48:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:15.132934 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b6364d5c-8fc8-44da-bb59-332cdc38c2ec None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:15.134131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b6364d5c-8fc8-44da-bb59-332cdc38c2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:15.138522 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070f801-bd8c-454e-8a84-e3c9072aa645 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:15.222718 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:15.246506 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 221/436] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:48:15.261358 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:15.271567 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6364d5c-8fc8-44da-bb59-332cdc38c2ec None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:15.275303 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070f801-bd8c-454e-8a84-e3c9072aa645 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:15.326743 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061c303-710f-483d-85f5-3fc466131f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:15.327314 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061c303-710f-483d-85f5-3fc466131f4d None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:15.327591 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061c303-710f-483d-85f5-3fc466131f4d None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:15.327874 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061c303-710f-483d-85f5-3fc466131f4d None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:15.328671 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061c303-710f-483d-85f5-3fc466131f4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:15.329360 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061c303-710f-483d-85f5-3fc466131f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:15.330438 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061c303-710f-483d-85f5-3fc466131f4d None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:15.341873 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 216/437] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:15.348144 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061c303-710f-483d-85f5-3fc466131f4d None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:15.394691 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6364d5c-8fc8-44da-bb59-332cdc38c2ec None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:15.431361 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb7c8-be47-42e0-8f22-a6c072791872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:15.432188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb7c8-be47-42e0-8f22-a6c072791872 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:15.432478 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb7c8-be47-42e0-8f22-a6c072791872 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:15.432762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb7c8-be47-42e0-8f22-a6c072791872 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:15.443161 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22eb7c8-be47-42e0-8f22-a6c072791872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-c22eb7c8-be47-42e0-8f22-a6c072791872 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:15.450853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:15.451740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:15.458131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:15.458131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:15.458131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:15.458131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:15.458131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:15.458131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:15.458131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:15.458131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:15.458131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:15.458131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:15.458131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:48:15.458131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:15.458131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 222/438] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:15.459018 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb7c8-be47-42e0-8f22-a6c072791872 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:15.467346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061c303-710f-483d-85f5-3fc466131f4d None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:15.504143 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff7898-957b-4ad2-9287-29a0e73dbc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:15.504813 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff7898-957b-4ad2-9287-29a0e73dbc56 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:15.505098 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff7898-957b-4ad2-9287-29a0e73dbc56 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:15.505372 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff7898-957b-4ad2-9287-29a0e73dbc56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:15.506800 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:15.528000 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:15.564947 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb7c8-be47-42e0-8f22-a6c072791872 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:15.577002 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff7898-957b-4ad2-9287-29a0e73dbc56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:15.578413 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff7898-957b-4ad2-9287-29a0e73dbc56 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:15.600143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f08f2-0d15-4edd-aefa-5ae9d58e54cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:15.600806 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f08f2-0d15-4edd-aefa-5ae9d58e54cf None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:15.601093 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f08f2-0d15-4edd-aefa-5ae9d58e54cf None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:15.601370 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f08f2-0d15-4edd-aefa-5ae9d58e54cf None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:15.602111 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f08f2-0d15-4edd-aefa-5ae9d58e54cf None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:15.602425 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f08f2-0d15-4edd-aefa-5ae9d58e54cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:15.603808 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f08f2-0d15-4edd-aefa-5ae9d58e54cf None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:15.611645 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 223/439] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:48:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:15.611645 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643c3f3-6937-46b3-b09f-ba2d9a42e6bf None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:15.611645 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643c3f3-6937-46b3-b09f-ba2d9a42e6bf None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:15.611645 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643c3f3-6937-46b3-b09f-ba2d9a42e6bf None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:15.611645 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 224/440] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:15.617764 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643c3f3-6937-46b3-b09f-ba2d9a42e6bf None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:15.679533 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 217/441] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:15.680835 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c561b73-e1ff-4f88-85aa-59c6af16209b None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:15.681128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c561b73-e1ff-4f88-85aa-59c6af16209b None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:15.681405 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c561b73-e1ff-4f88-85aa-59c6af16209b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:15.697818 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-1c561b73-e1ff-4f88-85aa-59c6af16209b None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:15.699007 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-1c561b73-e1ff-4f88-85aa-59c6af16209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:15.719036 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643c3f3-6937-46b3-b09f-ba2d9a42e6bf None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:15.726583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:15.747738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:15.756236 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671b3fe-abc3-4938-9577-be9face56273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:15.756941 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671b3fe-abc3-4938-9577-be9face56273 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:15.757231 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671b3fe-abc3-4938-9577-be9face56273 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:15.757533 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671b3fe-abc3-4938-9577-be9face56273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:15.767935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 218/442] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:15.768750 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c561b73-e1ff-4f88-85aa-59c6af16209b None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:15.830476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671b3fe-abc3-4938-9577-be9face56273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:15.831991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671b3fe-abc3-4938-9577-be9face56273 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:15.869608 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c561b73-e1ff-4f88-85aa-59c6af16209b None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:15.902078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da814e86-505d-4a18-90b4-730ecc66fc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:15.902930 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da814e86-505d-4a18-90b4-730ecc66fc9c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:15.903207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da814e86-505d-4a18-90b4-730ecc66fc9c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:15.903477 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da814e86-505d-4a18-90b4-730ecc66fc9c None admin] PATH_INFO: `/v3/projects/98e8f9ea0c4446b68d2be9ca4901c939` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:15.904736 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da814e86-505d-4a18-90b4-730ecc66fc9c None admin] RBAC: Authorizing `identity:get_project(project_id=98e8f9ea0c4446b68d2be9ca4901c939)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:15.906210 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da814e86-505d-4a18-90b4-730ecc66fc9c None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:15.907912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 219/443] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:48:15 2022] GET /identity/v3/projects/98e8f9ea0c4446b68d2be9ca4901c939 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:15.908707 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da814e86-505d-4a18-90b4-730ecc66fc9c None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:15.936170 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 225/444] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:15.937122 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671b3fe-abc3-4938-9577-be9face56273 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:15.945499 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:15.970465 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:16.022793 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da814e86-505d-4a18-90b4-730ecc66fc9c None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:16.038489 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671b3fe-abc3-4938-9577-be9face56273 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:16.057313 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f3e77-0332-40a7-9fbe-e51e8400ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:16.058121 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f3e77-0332-40a7-9fbe-e51e8400ee9c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:16.058407 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f3e77-0332-40a7-9fbe-e51e8400ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:16.058686 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f3e77-0332-40a7-9fbe-e51e8400ee9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:16.068818 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f3e77-0332-40a7-9fbe-e51e8400ee9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:16.071988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb6e16-60df-4664-bcdc-6f8482160034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:16.072844 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb6e16-60df-4664-bcdc-6f8482160034 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:16.073134 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb6e16-60df-4664-bcdc-6f8482160034 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:16.073416 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb6e16-60df-4664-bcdc-6f8482160034 None admin] PATH_INFO: `/v3/groups/4b49cad6230245008593d306c76d5611` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:16.074577 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb6e16-60df-4664-bcdc-6f8482160034 None admin] RBAC: Authorizing `identity:get_group(group_id=4b49cad6230245008593d306c76d5611)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:16.076062 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb6e16-60df-4664-bcdc-6f8482160034 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-456f3e77-0332-40a7-9fbe-e51e8400ee9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:16.076865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:16.083349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:16.084184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:16.084184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:16.084184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:16.084184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:16.084184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:16.084184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:16.084184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:16.084184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:16.084184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:16.084184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:16.084184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:48:16.084184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:16.084777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 226/445] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 14 11:48:15 2022] GET /identity/v3/groups/4b49cad6230245008593d306c76d5611 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:16.084845 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 220/446] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:48:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:16.084908 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb6e16-60df-4664-bcdc-6f8482160034 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:16.084970 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f3e77-0332-40a7-9fbe-e51e8400ee9c None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:16.153810 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:16.179235 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb6e16-60df-4664-bcdc-6f8482160034 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:16.189171 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f3e77-0332-40a7-9fbe-e51e8400ee9c None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:16.199677 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:16.214713 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceec20-ed84-408d-a9d4-86e98cef96ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:16.215573 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceec20-ed84-408d-a9d4-86e98cef96ac None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:16.215980 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceec20-ed84-408d-a9d4-86e98cef96ac None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:16.216265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceec20-ed84-408d-a9d4-86e98cef96ac None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:16.217464 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ceec20-ed84-408d-a9d4-86e98cef96ac None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:16.218915 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ceec20-ed84-408d-a9d4-86e98cef96ac None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:16.220627 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 227/447] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:48:16 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:16.221390 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceec20-ed84-408d-a9d4-86e98cef96ac None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:16.224734 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5277d1-444d-4d5c-b7d2-8e559349b7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:16.225425 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5277d1-444d-4d5c-b7d2-8e559349b7a2 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:16.225742 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5277d1-444d-4d5c-b7d2-8e559349b7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:16.226031 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5277d1-444d-4d5c-b7d2-8e559349b7a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:16.226861 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5277d1-444d-4d5c-b7d2-8e559349b7a2 None admin] RBAC: Adding query filter params (group.id=4b49cad6230245008593d306c76d5611, role.id=321ee52ce1bc4eafa201f23f55f23d2b, scope.project.id=98e8f9ea0c4446b68d2be9ca4901c939) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:16.227178 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5277d1-444d-4d5c-b7d2-8e559349b7a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:16.228665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5277d1-444d-4d5c-b7d2-8e559349b7a2 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:16.235138 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 221/448] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 14 11:48:16 2022] GET /identity/v3/role_assignments?group.id=4b49cad6230245008593d306c76d5611&scope.project.id=98e8f9ea0c4446b68d2be9ca4901c939&role.id=321ee52ce1bc4eafa201f23f55f23d2b => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:16.235954 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5277d1-444d-4d5c-b7d2-8e559349b7a2 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:16.333527 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceec20-ed84-408d-a9d4-86e98cef96ac None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:16.362105 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5277d1-444d-4d5c-b7d2-8e559349b7a2 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:16.370553 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa367d-6821-48ac-b25e-081efc309325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:16.371373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa367d-6821-48ac-b25e-081efc309325 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:16.371666 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa367d-6821-48ac-b25e-081efc309325 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:16.371987 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa367d-6821-48ac-b25e-081efc309325 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:16.372760 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa367d-6821-48ac-b25e-081efc309325 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:16.373078 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa367d-6821-48ac-b25e-081efc309325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:16.374522 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa367d-6821-48ac-b25e-081efc309325 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:16.384480 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 228/449] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:16.390115 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa367d-6821-48ac-b25e-081efc309325 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:16.394944 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:16.407711 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0485d3c-70e3-4406-b4bf-dc1765fc0627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:16.408878 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0485d3c-70e3-4406-b4bf-dc1765fc0627 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:16.408878 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0485d3c-70e3-4406-b4bf-dc1765fc0627 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:16.409281 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0485d3c-70e3-4406-b4bf-dc1765fc0627 None admin] PATH_INFO: `/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:16.410496 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0485d3c-70e3-4406-b4bf-dc1765fc0627 None admin] RBAC: Authorizing `identity:get_group(group_id=cb0fe99fc83e4a8eab48a80f05e6994a)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:16.412023 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0485d3c-70e3-4406-b4bf-dc1765fc0627 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:16.413665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 222/450] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 14 11:48:16 2022] GET /identity/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:16.419735 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0485d3c-70e3-4406-b4bf-dc1765fc0627 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:16.467204 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:16.504219 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa367d-6821-48ac-b25e-081efc309325 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:16.526268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0485d3c-70e3-4406-b4bf-dc1765fc0627 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:16.538599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77a53b-3fee-4196-9123-fc84e6f09570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:16.539243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77a53b-3fee-4196-9123-fc84e6f09570 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:16.539528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77a53b-3fee-4196-9123-fc84e6f09570 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:16.539810 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77a53b-3fee-4196-9123-fc84e6f09570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:16.560039 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b8636-8c9d-4148-81ae-55b3dbf0f979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:16.560685 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8636-8c9d-4148-81ae-55b3dbf0f979 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:16.560967 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8636-8c9d-4148-81ae-55b3dbf0f979 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:16.561245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8636-8c9d-4148-81ae-55b3dbf0f979 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:16.562061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b8636-8c9d-4148-81ae-55b3dbf0f979 None admin] RBAC: Adding query filter params (group.id=cb0fe99fc83e4a8eab48a80f05e6994a, role.id=7b517960be1c437d850537c7e0aa985a, scope.project.id=3bab82494d694b8db2b6698451bdf404) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:16.562375 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b8636-8c9d-4148-81ae-55b3dbf0f979 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:16.563793 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b8636-8c9d-4148-81ae-55b3dbf0f979 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:16.570764 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 223/451] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 14 11:48:16 2022] GET /identity/v3/role_assignments?group.id=cb0fe99fc83e4a8eab48a80f05e6994a&scope.project.id=3bab82494d694b8db2b6698451bdf404&role.id=7b517960be1c437d850537c7e0aa985a => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:16.611876 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77a53b-3fee-4196-9123-fc84e6f09570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:16.613389 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77a53b-3fee-4196-9123-fc84e6f09570 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:16.617303 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:16.720758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 229/452] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:16.726559 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b8636-8c9d-4148-81ae-55b3dbf0f979 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:16.836543 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b8636-8c9d-4148-81ae-55b3dbf0f979 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:16.843618 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:16.873564 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a20803-9d6c-4fd1-b844-136c165cd0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:16.874348 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a20803-9d6c-4fd1-b844-136c165cd0c8 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:16.874639 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a20803-9d6c-4fd1-b844-136c165cd0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:16.874923 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a20803-9d6c-4fd1-b844-136c165cd0c8 None admin] PATH_INFO: `/v3/projects/3bab82494d694b8db2b6698451bdf404` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:16.876182 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a20803-9d6c-4fd1-b844-136c165cd0c8 None admin] RBAC: Authorizing `identity:get_project(project_id=3bab82494d694b8db2b6698451bdf404)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:16.877633 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a20803-9d6c-4fd1-b844-136c165cd0c8 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:16.879327 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 224/453] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 14 11:48:16 2022] GET /identity/v3/projects/3bab82494d694b8db2b6698451bdf404 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:16.886064 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77a53b-3fee-4196-9123-fc84e6f09570 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:16.996717 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77a53b-3fee-4196-9123-fc84e6f09570 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:16.998979 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:17.031090 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18997176-1bc0-4123-836a-53d11fcc0f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:17.031967 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18997176-1bc0-4123-836a-53d11fcc0f4e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:17.032276 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18997176-1bc0-4123-836a-53d11fcc0f4e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:17.032537 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18997176-1bc0-4123-836a-53d11fcc0f4e None admin] PATH_INFO: `/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:17.033686 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18997176-1bc0-4123-836a-53d11fcc0f4e None admin] RBAC: Authorizing `identity:get_group(group_id=cb0fe99fc83e4a8eab48a80f05e6994a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:17.035114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18997176-1bc0-4123-836a-53d11fcc0f4e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:17.036951 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 230/454] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 14 11:48:16 2022] GET /identity/v3/groups/cb0fe99fc83e4a8eab48a80f05e6994a => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:17.043083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a20803-9d6c-4fd1-b844-136c165cd0c8 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:17.142066 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a20803-9d6c-4fd1-b844-136c165cd0c8 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:17.174568 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa964ff-196a-4c9e-93d3-629241521c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:17.175227 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa964ff-196a-4c9e-93d3-629241521c21 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:17.175516 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa964ff-196a-4c9e-93d3-629241521c21 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:17.175799 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa964ff-196a-4c9e-93d3-629241521c21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:17.176667 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa964ff-196a-4c9e-93d3-629241521c21 None admin] RBAC: Adding query filter params (group.id=cb0fe99fc83e4a8eab48a80f05e6994a, role.id=703199a2f03143128fbac7cc8481b912, scope.project.id=3bab82494d694b8db2b6698451bdf404) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:17.177914 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa964ff-196a-4c9e-93d3-629241521c21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:17.178987 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa964ff-196a-4c9e-93d3-629241521c21 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:17.184968 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 225/455] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 14 11:48:17 2022] GET /identity/v3/role_assignments?group.id=cb0fe99fc83e4a8eab48a80f05e6994a&scope.project.id=3bab82494d694b8db2b6698451bdf404&role.id=703199a2f03143128fbac7cc8481b912 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:19.867609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aada1e-6076-4db3-a03f-5b95290440ac None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:19.867609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aada1e-6076-4db3-a03f-5b95290440ac None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:19.867609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aada1e-6076-4db3-a03f-5b95290440ac None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:19.868626 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 231/456] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:19.874873 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bc165-3ec8-4261-81f0-524e00c15c25 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:19.875862 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bc165-3ec8-4261-81f0-524e00c15c25 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:19.876442 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bc165-3ec8-4261-81f0-524e00c15c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:19.896562 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-700bc165-3ec8-4261-81f0-524e00c15c25 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:19.899305 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-700bc165-3ec8-4261-81f0-524e00c15c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:19.944223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:19.993329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 226/457] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:48:20.023468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aada1e-6076-4db3-a03f-5b95290440ac None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:20.088125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5922b-77ce-4628-8818-b5bf4035df16 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:20.088741 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5922b-77ce-4628-8818-b5bf4035df16 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:20.089022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5922b-77ce-4628-8818-b5bf4035df16 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:20.090390 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 227/458] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:48:20.095739 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ef6fe-44e2-48ec-9d62-1978127cb222 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:20.096318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ef6fe-44e2-48ec-9d62-1978127cb222 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:20.096790 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ef6fe-44e2-48ec-9d62-1978127cb222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:20.115000 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-c85ef6fe-44e2-48ec-9d62-1978127cb222 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:20.116652 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-c85ef6fe-44e2-48ec-9d62-1978127cb222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:20.149993 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aada1e-6076-4db3-a03f-5b95290440ac None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:20.200632 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e92557-bc5c-40e0-a7d9-5fa6310cc89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:20.202343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e92557-bc5c-40e0-a7d9-5fa6310cc89e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:20.202773 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e92557-bc5c-40e0-a7d9-5fa6310cc89e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:20.203345 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e92557-bc5c-40e0-a7d9-5fa6310cc89e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:20.217532 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e92557-bc5c-40e0-a7d9-5fa6310cc89e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:20.219253 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e92557-bc5c-40e0-a7d9-5fa6310cc89e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:20.220687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 228/459] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:20.222862 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b0ef2-1ab3-4b21-b3a6-4cb0fda5934f None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:20.223284 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b0ef2-1ab3-4b21-b3a6-4cb0fda5934f None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:20.223574 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b0ef2-1ab3-4b21-b3a6-4cb0fda5934f None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:20.226078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 229/460] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:20.239930 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f78c9-89a5-4f6d-a084-763c55b36b63 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:20.239930 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f78c9-89a5-4f6d-a084-763c55b36b63 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:20.239930 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f78c9-89a5-4f6d-a084-763c55b36b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:20.251357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-87e92557-bc5c-40e0-a7d9-5fa6310cc89e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:20.251357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:20.251357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:20.251357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:20.251357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:20.251357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:20.251357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:20.251357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:20.251357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:20.251357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:20.251357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:20.251357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:20.251357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:20.251357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:20.251357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:20.253466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:20.254742 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:20.254742 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:20.254742 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:20.254742 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:20.254970 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-151f78c9-89a5-4f6d-a084-763c55b36b63 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:20.255039 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 232/461] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:20.255039 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e92557-bc5c-40e0-a7d9-5fa6310cc89e None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:20.257287 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-151f78c9-89a5-4f6d-a084-763c55b36b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:20.292754 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:20.334069 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 230/462] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:48:20.334922 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f78c9-89a5-4f6d-a084-763c55b36b63 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:20.372755 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:20.393634 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e92557-bc5c-40e0-a7d9-5fa6310cc89e None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:20.435041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e4b02-8cf4-4ea0-a272-95f4f99a7362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:20.435511 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e4b02-8cf4-4ea0-a272-95f4f99a7362 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:20.435798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e4b02-8cf4-4ea0-a272-95f4f99a7362 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:20.436115 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e4b02-8cf4-4ea0-a272-95f4f99a7362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:20.449194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e4b02-8cf4-4ea0-a272-95f4f99a7362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:20.450682 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e4b02-8cf4-4ea0-a272-95f4f99a7362 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:20.470975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-542e4b02-8cf4-4ea0-a272-95f4f99a7362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:20.470975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:20.470975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:20.470975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:20.470975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:20.470975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:20.470975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:20.470975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:20.470975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:20.470975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:20.470975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:20.470975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:20.470975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:20.470975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:20.470975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:20.472217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:20.473042 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:20.473042 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:20.473042 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:20.473042 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:20.473240 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f78c9-89a5-4f6d-a084-763c55b36b63 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:20.476222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 233/463] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:20.477383 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e4b02-8cf4-4ea0-a272-95f4f99a7362 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:20.513198 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942979cf-c3f9-4de1-a29a-f967b4bf1516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:20.514177 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942979cf-c3f9-4de1-a29a-f967b4bf1516 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:20.514465 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942979cf-c3f9-4de1-a29a-f967b4bf1516 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:20.514743 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942979cf-c3f9-4de1-a29a-f967b4bf1516 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:20.515478 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942979cf-c3f9-4de1-a29a-f967b4bf1516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:20.515792 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942979cf-c3f9-4de1-a29a-f967b4bf1516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:20.517255 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942979cf-c3f9-4de1-a29a-f967b4bf1516 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:20.533676 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 231/464] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:20.533676 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942979cf-c3f9-4de1-a29a-f967b4bf1516 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:20.571298 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:20.599010 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e4b02-8cf4-4ea0-a272-95f4f99a7362 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:20.634746 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:20.638735 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02c19c-618f-4dc8-bec3-6cd2bf8a06f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:20.639544 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02c19c-618f-4dc8-bec3-6cd2bf8a06f5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:20.639838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02c19c-618f-4dc8-bec3-6cd2bf8a06f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:20.640164 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02c19c-618f-4dc8-bec3-6cd2bf8a06f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:20.649896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942979cf-c3f9-4de1-a29a-f967b4bf1516 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:20.651784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02c19c-618f-4dc8-bec3-6cd2bf8a06f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:20.653346 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02c19c-618f-4dc8-bec3-6cd2bf8a06f5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:20.671730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-aa02c19c-618f-4dc8-bec3-6cd2bf8a06f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:20.671730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:20.671730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:20.671730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:20.671730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:20.671730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:20.671730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:20.671730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:20.671730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:20.671730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:20.671730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:20.671730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:20.671730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:20.671730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:20.671730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:20.672650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:20.673445 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:20.673445 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:20.673445 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:20.673445 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:20.673445 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 234/465] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:20.674204 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02c19c-618f-4dc8-bec3-6cd2bf8a06f5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:20.688782 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bbdeb-551c-443d-b2a6-e9571da58bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:20.689375 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bbdeb-551c-443d-b2a6-e9571da58bb3 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:20.689659 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bbdeb-551c-443d-b2a6-e9571da58bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:20.689939 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bbdeb-551c-443d-b2a6-e9571da58bb3 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:20.690652 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bbdeb-551c-443d-b2a6-e9571da58bb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:20.690961 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bbdeb-551c-443d-b2a6-e9571da58bb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:20.692377 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bbdeb-551c-443d-b2a6-e9571da58bb3 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:20.704323 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 232/466] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:20.705535 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfcd5f-46ab-451d-ba26-eea981c8fc91 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:20.705823 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfcd5f-46ab-451d-ba26-eea981c8fc91 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:20.706099 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfcd5f-46ab-451d-ba26-eea981c8fc91 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:20.707451 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 233/467] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:20.708035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfcd5f-46ab-451d-ba26-eea981c8fc91 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:20.776339 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02c19c-618f-4dc8-bec3-6cd2bf8a06f5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:20.802929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:20.810673 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfcd5f-46ab-451d-ba26-eea981c8fc91 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:20.812790 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ccf2e-cb01-4b46-a1b7-ef1ec88fcf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:20.814268 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ccf2e-cb01-4b46-a1b7-ef1ec88fcf75 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:20.814563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ccf2e-cb01-4b46-a1b7-ef1ec88fcf75 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:20.814846 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ccf2e-cb01-4b46-a1b7-ef1ec88fcf75 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:20.815554 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ccf2e-cb01-4b46-a1b7-ef1ec88fcf75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:20.817056 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ccf2e-cb01-4b46-a1b7-ef1ec88fcf75 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:20.838152 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 235/468] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 14 11:48:20 2022] POST /identity/v3/users => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:48:20.839115 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ccf2e-cb01-4b46-a1b7-ef1ec88fcf75 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:20.855219 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee91d83-187b-46b4-a21e-c9ff3ef49f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:20.855939 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91d83-187b-46b4-a21e-c9ff3ef49f36 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:20.856297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91d83-187b-46b4-a21e-c9ff3ef49f36 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:20.856579 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91d83-187b-46b4-a21e-c9ff3ef49f36 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:20.857326 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee91d83-187b-46b4-a21e-c9ff3ef49f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:20.857637 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee91d83-187b-46b4-a21e-c9ff3ef49f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:20.859067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee91d83-187b-46b4-a21e-c9ff3ef49f36 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:20.873048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 234/469] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:20.875807 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d770b6-b4ed-4491-baac-fc14f406b262 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:20.877258 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d770b6-b4ed-4491-baac-fc14f406b262 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:20.878590 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d770b6-b4ed-4491-baac-fc14f406b262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:20.901966 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-13d770b6-b4ed-4491-baac-fc14f406b262 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:20.904496 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-13d770b6-b4ed-4491-baac-fc14f406b262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:20.907105 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:20.958286 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ccf2e-cb01-4b46-a1b7-ef1ec88fcf75 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:20.986158 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 235/470] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:20.987371 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d770b6-b4ed-4491-baac-fc14f406b262 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:21.004541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ae2ef-4a89-42d4-9ef0-8e52394528ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:21.006066 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ae2ef-4a89-42d4-9ef0-8e52394528ed None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:21.006498 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ae2ef-4a89-42d4-9ef0-8e52394528ed None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:21.006969 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ae2ef-4a89-42d4-9ef0-8e52394528ed None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:21.008029 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ae2ef-4a89-42d4-9ef0-8e52394528ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:21.010804 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ae2ef-4a89-42d4-9ef0-8e52394528ed None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:21.035338 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 236/471] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 14 11:48:20 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:48:21.036332 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ae2ef-4a89-42d4-9ef0-8e52394528ed None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:21.094310 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:21.132125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d770b6-b4ed-4491-baac-fc14f406b262 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:21.181075 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ae2ef-4a89-42d4-9ef0-8e52394528ed None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:21.189174 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d5540-e59d-46d8-b4bf-468d23e111b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:21.190946 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d5540-e59d-46d8-b4bf-468d23e111b4 None admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:21.191439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d5540-e59d-46d8-b4bf-468d23e111b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:21.191955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d5540-e59d-46d8-b4bf-468d23e111b4 None admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:21.193357 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d5540-e59d-46d8-b4bf-468d23e111b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:21.195824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d5540-e59d-46d8-b4bf-468d23e111b4 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:21.210174 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:21.226974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9a98f-93eb-44ef-93ff-f69f2ab6dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:21.228015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9a98f-93eb-44ef-93ff-f69f2ab6dd72 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:21.228510 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9a98f-93eb-44ef-93ff-f69f2ab6dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:21.228869 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9a98f-93eb-44ef-93ff-f69f2ab6dd72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:21.233796 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 236/472] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 14 11:48:20 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:48:21.245528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9a98f-93eb-44ef-93ff-f69f2ab6dd72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:21.247066 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9a98f-93eb-44ef-93ff-f69f2ab6dd72 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:21.267761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-a6c9a98f-93eb-44ef-93ff-f69f2ab6dd72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:21.267761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:21.267761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:21.267761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:21.267761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:21.267761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:21.267761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:21.267761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:21.267761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:21.267761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:21.267761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:21.267761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:21.267761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:21.267761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:21.267761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:21.268784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:21.269609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:21.269609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:21.269609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:21.269609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:21.269609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 237/473] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:21.276813 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d5540-e59d-46d8-b4bf-468d23e111b4 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:21.408584 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d5540-e59d-46d8-b4bf-468d23e111b4 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:21.446587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c171e98-f923-4972-a0bf-c6e9cf0d3817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:21.447835 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c171e98-f923-4972-a0bf-c6e9cf0d3817 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:21.448186 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c171e98-f923-4972-a0bf-c6e9cf0d3817 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:21.448443 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c171e98-f923-4972-a0bf-c6e9cf0d3817 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:21.449279 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c171e98-f923-4972-a0bf-c6e9cf0d3817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:21.449593 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c171e98-f923-4972-a0bf-c6e9cf0d3817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:21.450970 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c171e98-f923-4972-a0bf-c6e9cf0d3817 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:21.464430 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 237/474] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:21.469743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9a98f-93eb-44ef-93ff-f69f2ab6dd72 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:21.569872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:21.579842 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9a98f-93eb-44ef-93ff-f69f2ab6dd72 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:21.617202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee8b4d-8627-4599-9a24-b470ff621fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:21.617865 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee8b4d-8627-4599-9a24-b470ff621fb1 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:21.618155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee8b4d-8627-4599-9a24-b470ff621fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:21.618434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee8b4d-8627-4599-9a24-b470ff621fb1 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:21.619175 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee8b4d-8627-4599-9a24-b470ff621fb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:21.621665 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee8b4d-8627-4599-9a24-b470ff621fb1 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:21.653302 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 238/475] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 14 11:48:21 2022] POST /identity/v3/users => generated 249 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:48:23.339270 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4586b1-1651-4c4d-81ea-2c9ea43299be None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:23.340519 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4586b1-1651-4c4d-81ea-2c9ea43299be None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:23.340519 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4586b1-1651-4c4d-81ea-2c9ea43299be None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:23.342039 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 238/476] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:23.347440 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb75dc-a6d9-48a9-a52f-5245dd41c162 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:23.347838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb75dc-a6d9-48a9-a52f-5245dd41c162 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:23.348044 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb75dc-a6d9-48a9-a52f-5245dd41c162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:23.365107 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-d0bb75dc-a6d9-48a9-a52f-5245dd41c162 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:23.366315 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d0bb75dc-a6d9-48a9-a52f-5245dd41c162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:23.448093 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 239/477] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:23.468193 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4586b1-1651-4c4d-81ea-2c9ea43299be None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:23.526543 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:23.552872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8563689-3159-4563-b37f-07dedd2276e1 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:23.553176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8563689-3159-4563-b37f-07dedd2276e1 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:23.553545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8563689-3159-4563-b37f-07dedd2276e1 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:23.555068 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 240/478] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:23.560872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913922-9b6d-46db-8ce3-443739b6a52b None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:23.561169 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913922-9b6d-46db-8ce3-443739b6a52b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:23.561457 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913922-9b6d-46db-8ce3-443739b6a52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:23.577376 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4586b1-1651-4c4d-81ea-2c9ea43299be None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:23.579965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c7913922-9b6d-46db-8ce3-443739b6a52b None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:23.581365 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c7913922-9b6d-46db-8ce3-443739b6a52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:23.620208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9b395-61eb-49f7-95f8-f8e2e59a240c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:23.621004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9b395-61eb-49f7-95f8-f8e2e59a240c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:23.621811 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9b395-61eb-49f7-95f8-f8e2e59a240c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:23.622202 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9b395-61eb-49f7-95f8-f8e2e59a240c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:23.635221 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9b395-61eb-49f7-95f8-f8e2e59a240c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-7de9b395-61eb-49f7-95f8-f8e2e59a240c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:23.645646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:23.646557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:23.647336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:23.647336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:23.647336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:23.647336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:23.647336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:23.647336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:23.647336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:23.647336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:23.647336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:23.647336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:23.647336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:23.647336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:23.647336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 239/479] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:48:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:23.655515 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9b395-61eb-49f7-95f8-f8e2e59a240c None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:23.672306 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 241/480] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:23.689835 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7913922-9b6d-46db-8ce3-443739b6a52b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:23.703618 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:23.791030 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9b395-61eb-49f7-95f8-f8e2e59a240c None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:23.806757 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:23.820091 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7913922-9b6d-46db-8ce3-443739b6a52b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:23.831766 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e806831-b6d3-4b59-bcba-adccc4e74841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:23.832470 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e806831-b6d3-4b59-bcba-adccc4e74841 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:23.832755 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e806831-b6d3-4b59-bcba-adccc4e74841 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:23.833136 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e806831-b6d3-4b59-bcba-adccc4e74841 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:23.833783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e806831-b6d3-4b59-bcba-adccc4e74841 None admin] RBAC: Adding query filter params (name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:23.834094 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e806831-b6d3-4b59-bcba-adccc4e74841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:23.835475 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e806831-b6d3-4b59-bcba-adccc4e74841 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:23.844531 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 240/481] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 14 11:48:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:23.845621 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77713b-21bc-4ddc-a851-160871956b23 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:23.845914 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77713b-21bc-4ddc-a851-160871956b23 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:23.846195 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77713b-21bc-4ddc-a851-160871956b23 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:23.847543 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 241/482] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:23.849960 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77713b-21bc-4ddc-a851-160871956b23 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:23.862730 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea655f27-5a60-44ed-8988-66e1057d7230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:23.863593 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea655f27-5a60-44ed-8988-66e1057d7230 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:23.863860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea655f27-5a60-44ed-8988-66e1057d7230 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:23.864141 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea655f27-5a60-44ed-8988-66e1057d7230 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:23.875937 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea655f27-5a60-44ed-8988-66e1057d7230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-ea655f27-5a60-44ed-8988-66e1057d7230 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:23.883690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:23.884795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:23.890059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:23.890059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:23.890059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:23.890059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:23.890059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:23.890059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:23.890059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:23.890059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:23.890059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:23.890059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:23.890059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:23.890059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:23.890059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 242/483] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:48:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:23.890059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61b770-1ad1-4c6a-891a-fd1b31864145 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:23.890995 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61b770-1ad1-4c6a-891a-fd1b31864145 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:23.890995 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61b770-1ad1-4c6a-891a-fd1b31864145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:23.907162 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-be61b770-1ad1-4c6a-891a-fd1b31864145 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:23.908406 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-be61b770-1ad1-4c6a-891a-fd1b31864145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:23.971344 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77713b-21bc-4ddc-a851-160871956b23 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:23.975728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:23.992042 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 243/484] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:23.992042 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61b770-1ad1-4c6a-891a-fd1b31864145 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:24.008761 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10a311-3941-4f26-aea8-809a81431ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:24.009572 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10a311-3941-4f26-aea8-809a81431ccb None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:24.009862 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10a311-3941-4f26-aea8-809a81431ccb None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:24.010146 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10a311-3941-4f26-aea8-809a81431ccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:24.022391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10a311-3941-4f26-aea8-809a81431ccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:24.023864 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10a311-3941-4f26-aea8-809a81431ccb None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:24.042847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-2a10a311-3941-4f26-aea8-809a81431ccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:24.042847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:24.042847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:24.042847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:24.042847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:24.042847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:24.042847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:24.042847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:24.042847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:24.042847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:24.042847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:24.042847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:24.042847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:24.042847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:24.042847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:24.044582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:24.047193 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:24.047193 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:24.047193 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:24.047193 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:24.047193 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 242/485] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:24.049209 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10a311-3941-4f26-aea8-809a81431ccb None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:24.084000 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:24.113539 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61b770-1ad1-4c6a-891a-fd1b31864145 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:24.151437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465dea3-8281-428f-bcbc-964d68cf86eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:24.152253 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465dea3-8281-428f-bcbc-964d68cf86eb None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:24.152546 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465dea3-8281-428f-bcbc-964d68cf86eb None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:24.152969 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465dea3-8281-428f-bcbc-964d68cf86eb None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:24.154216 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465dea3-8281-428f-bcbc-964d68cf86eb None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:24.154537 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465dea3-8281-428f-bcbc-964d68cf86eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:24.156071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465dea3-8281-428f-bcbc-964d68cf86eb None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:24.164433 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 244/486] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 14 11:48:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:24.165415 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465dea3-8281-428f-bcbc-964d68cf86eb None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:24.178638 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10a311-3941-4f26-aea8-809a81431ccb None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:24.221822 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bcadd-e9bc-4185-adb8-282cea824a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:24.222537 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bcadd-e9bc-4185-adb8-282cea824a4e None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:24.222828 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bcadd-e9bc-4185-adb8-282cea824a4e None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:24.223109 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bcadd-e9bc-4185-adb8-282cea824a4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:24.230237 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:24.233936 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bcadd-e9bc-4185-adb8-282cea824a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-f87bcadd-e9bc-4185-adb8-282cea824a4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:24.241701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:24.242622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:24.243396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:24.243396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:24.243396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:24.243396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:24.243396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:24.243396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:24.243396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:24.243396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:24.243396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:24.243396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:24.243396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:24.243396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:24.243396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 243/487] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:48:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:24.244078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bcadd-e9bc-4185-adb8-282cea824a4e None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:24.272172 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465dea3-8281-428f-bcbc-964d68cf86eb None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:24.305595 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cacb3-0b23-4cec-9a52-3dc313ea1e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:24.306235 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cacb3-0b23-4cec-9a52-3dc313ea1e3c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:24.306533 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cacb3-0b23-4cec-9a52-3dc313ea1e3c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:24.306816 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cacb3-0b23-4cec-9a52-3dc313ea1e3c None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:24.307544 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cacb3-0b23-4cec-9a52-3dc313ea1e3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:24.307861 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cacb3-0b23-4cec-9a52-3dc313ea1e3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:24.309790 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cacb3-0b23-4cec-9a52-3dc313ea1e3c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:24.328229 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 245/488] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:24.331242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a22fe1-a45b-42d6-9031-3fc456a31ef3 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:24.331699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a22fe1-a45b-42d6-9031-3fc456a31ef3 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:24.332016 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a22fe1-a45b-42d6-9031-3fc456a31ef3 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:24.333280 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 246/489] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:24.333984 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a22fe1-a45b-42d6-9031-3fc456a31ef3 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:24.337094 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:24.349853 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bcadd-e9bc-4185-adb8-282cea824a4e None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:24.383305 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864767f-98a1-4bef-9952-321b63da9a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:24.384117 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864767f-98a1-4bef-9952-321b63da9a8c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:24.384401 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864767f-98a1-4bef-9952-321b63da9a8c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:24.384678 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864767f-98a1-4bef-9952-321b63da9a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:24.395307 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864767f-98a1-4bef-9952-321b63da9a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:24.396793 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864767f-98a1-4bef-9952-321b63da9a8c None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:24.414205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-9864767f-98a1-4bef-9952-321b63da9a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:24.414205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:24.414205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:24.414205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:24.414205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:24.414205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:24.414205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:24.414205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:24.414205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:24.414205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:24.414205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:24.414205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:24.414205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:24.414205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:24.414205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:24.415068 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:24.415882 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:24.415882 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:24.415882 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:24.415882 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:24.415882 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 244/490] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:24.416173 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864767f-98a1-4bef-9952-321b63da9a8c None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:24.443139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a22fe1-a45b-42d6-9031-3fc456a31ef3 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:24.462801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:24.477800 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfff2ca-d74a-4809-9060-d8abd1b5e9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:24.478401 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfff2ca-d74a-4809-9060-d8abd1b5e9c2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:24.478688 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfff2ca-d74a-4809-9060-d8abd1b5e9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:24.478978 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfff2ca-d74a-4809-9060-d8abd1b5e9c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:24.479704 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfff2ca-d74a-4809-9060-d8abd1b5e9c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:24.480042 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfff2ca-d74a-4809-9060-d8abd1b5e9c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:24.481620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfff2ca-d74a-4809-9060-d8abd1b5e9c2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:24.489723 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 247/491] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 14 11:48:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:24.491114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be68930-968b-4aaf-9d22-511b8112f66b None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:24.491411 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be68930-968b-4aaf-9d22-511b8112f66b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:24.491694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be68930-968b-4aaf-9d22-511b8112f66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:24.508059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-4be68930-968b-4aaf-9d22-511b8112f66b None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:24.509357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4be68930-968b-4aaf-9d22-511b8112f66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:24.519164 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864767f-98a1-4bef-9952-321b63da9a8c None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:24.552266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b6e99-b626-4e25-80ba-85e38db4e6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:24.553052 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b6e99-b626-4e25-80ba-85e38db4e6a5 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:24.553336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b6e99-b626-4e25-80ba-85e38db4e6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:24.553615 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b6e99-b626-4e25-80ba-85e38db4e6a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:24.561541 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b6e99-b626-4e25-80ba-85e38db4e6a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:24.562987 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b6e99-b626-4e25-80ba-85e38db4e6a5 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:24.565812 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:24.576250 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 248/492] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:24.577156 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be68930-968b-4aaf-9d22-511b8112f66b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-f07b6e99-b626-4e25-80ba-85e38db4e6a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:48:24.580027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:24.581119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:24.582159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:24.582159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:24.582159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:48:24.582159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:48:24.582159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:48:24.582159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:48:24.582159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:48:24.582159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:48:24.582159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:48:24.582159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:24.582159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 245/493] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Jul 14 11:48:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:24.582159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b6e99-b626-4e25-80ba-85e38db4e6a5 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:24.684040 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be68930-968b-4aaf-9d22-511b8112f66b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:24.686023 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b6e99-b626-4e25-80ba-85e38db4e6a5 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:24.697942 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:24.720146 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72302732-1f9e-4df9-93ad-7a5cd1cc19bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:24.720814 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72302732-1f9e-4df9-93ad-7a5cd1cc19bf None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:24.720977 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf9a1b-020c-4eb8-8b25-33a6de3c73f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:24.721087 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72302732-1f9e-4df9-93ad-7a5cd1cc19bf None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:24.721364 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72302732-1f9e-4df9-93ad-7a5cd1cc19bf None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:24.722074 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf9a1b-020c-4eb8-8b25-33a6de3c73f2 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:24.722228 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72302732-1f9e-4df9-93ad-7a5cd1cc19bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:24.722364 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf9a1b-020c-4eb8-8b25-33a6de3c73f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:24.722502 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72302732-1f9e-4df9-93ad-7a5cd1cc19bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:24.722641 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf9a1b-020c-4eb8-8b25-33a6de3c73f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:24.723774 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72302732-1f9e-4df9-93ad-7a5cd1cc19bf None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:24.735565 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf9a1b-020c-4eb8-8b25-33a6de3c73f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:24.736907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 249/494] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:24.737029 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf9a1b-020c-4eb8-8b25-33a6de3c73f2 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:24.737931 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72302732-1f9e-4df9-93ad-7a5cd1cc19bf None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:24.757463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-fdaf9a1b-020c-4eb8-8b25-33a6de3c73f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:24.757463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:24.757463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:24.757463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:24.757463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:24.757463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:24.757463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:24.757463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:24.757463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:24.757463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:24.757463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:24.757463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:24.757463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:24.757463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:24.757463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:24.758547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:24.759403 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:24.759403 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:24.759403 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:24.759403 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:24.759403 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 246/495] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:24.759771 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf9a1b-020c-4eb8-8b25-33a6de3c73f2 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:24.813592 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:24.846483 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72302732-1f9e-4df9-93ad-7a5cd1cc19bf None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:24.862538 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf9a1b-020c-4eb8-8b25-33a6de3c73f2 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:24.880986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270f7d0-6989-40ee-a9a9-6d68f87b929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:24.881153 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270f7d0-6989-40ee-a9a9-6d68f87b929f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:24.881359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270f7d0-6989-40ee-a9a9-6d68f87b929f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:24.881645 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270f7d0-6989-40ee-a9a9-6d68f87b929f None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:24.882479 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270f7d0-6989-40ee-a9a9-6d68f87b929f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:24.882794 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270f7d0-6989-40ee-a9a9-6d68f87b929f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:24.884270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270f7d0-6989-40ee-a9a9-6d68f87b929f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:24.896039 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587a54c-1980-431c-8666-5d387e944b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:24.896827 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587a54c-1980-431c-8666-5d387e944b64 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:24.897108 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587a54c-1980-431c-8666-5d387e944b64 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:24.897383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587a54c-1980-431c-8666-5d387e944b64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:24.910889 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587a54c-1980-431c-8666-5d387e944b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-2587a54c-1980-431c-8666-5d387e944b64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:24.918581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:24.920329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:24.921187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:24.921187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:24.921187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:24.921187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:24.921187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:24.921187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:24.921187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:24.921187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:24.921187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:24.921187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:24.921187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:24.921187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:24.921187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 247/496] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:48:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:24.921187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587a54c-1980-431c-8666-5d387e944b64 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:24.930167 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 250/497] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Jul 14 11:48:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:24.930167 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270f7d0-6989-40ee-a9a9-6d68f87b929f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:24.957450 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:25.023995 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587a54c-1980-431c-8666-5d387e944b64 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:25.026682 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270f7d0-6989-40ee-a9a9-6d68f87b929f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:25.037683 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:25.059503 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccbdd9-1987-40e1-b04e-7fa14805764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:25.060566 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccbdd9-1987-40e1-b04e-7fa14805764c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:25.060810 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccbdd9-1987-40e1-b04e-7fa14805764c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:25.061267 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccbdd9-1987-40e1-b04e-7fa14805764c None admin] PATH_INFO: `/v3/users/glance` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:25.062800 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095dcac-4e6e-4a89-a3f3-09e1470f3051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:25.063463 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095dcac-4e6e-4a89-a3f3-09e1470f3051 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:25.063758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095dcac-4e6e-4a89-a3f3-09e1470f3051 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:25.064074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095dcac-4e6e-4a89-a3f3-09e1470f3051 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:25.064820 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095dcac-4e6e-4a89-a3f3-09e1470f3051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:25.065134 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095dcac-4e6e-4a89-a3f3-09e1470f3051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:25.066533 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095dcac-4e6e-4a89-a3f3-09e1470f3051 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:25.069576 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccbdd9-1987-40e1-b04e-7fa14805764c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:25.071052 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccbdd9-1987-40e1-b04e-7fa14805764c None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:25.077748 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 251/498] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:25.078562 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095dcac-4e6e-4a89-a3f3-09e1470f3051 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-a5ccbdd9-1987-40e1-b04e-7fa14805764c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:48:25.085254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:25.086180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:25.087038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:25.087038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:25.087038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:48:25.087038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:48:25.087038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:48:25.087038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:48:25.087038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:48:25.087038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:48:25.087038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:48:25.087038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:25.087038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 248/499] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:25.088151 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccbdd9-1987-40e1-b04e-7fa14805764c None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:25.175088 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:25.185535 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095dcac-4e6e-4a89-a3f3-09e1470f3051 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:25.192766 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccbdd9-1987-40e1-b04e-7fa14805764c None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:25.220318 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea3e55-668a-43fe-9e47-df455d23ffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:25.220983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea3e55-668a-43fe-9e47-df455d23ffec None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:25.221268 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea3e55-668a-43fe-9e47-df455d23ffec None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:25.221549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea3e55-668a-43fe-9e47-df455d23ffec None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:25.222295 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea3e55-668a-43fe-9e47-df455d23ffec None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:25.222608 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea3e55-668a-43fe-9e47-df455d23ffec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:25.224077 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea3e55-668a-43fe-9e47-df455d23ffec None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:25.226356 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152ff1b-96f3-43b3-b67d-1dca0e8ecd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:25.226993 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ff1b-96f3-43b3-b67d-1dca0e8ecd0c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:25.227280 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ff1b-96f3-43b3-b67d-1dca0e8ecd0c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:25.227557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ff1b-96f3-43b3-b67d-1dca0e8ecd0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:25.231959 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 252/500] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 14 11:48:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:25.233636 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea3e55-668a-43fe-9e47-df455d23ffec None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:25.268064 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:25.296268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152ff1b-96f3-43b3-b67d-1dca0e8ecd0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:25.297677 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152ff1b-96f3-43b3-b67d-1dca0e8ecd0c None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:25.334474 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea3e55-668a-43fe-9e47-df455d23ffec None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:25.369121 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf9cfb-3cc2-4fa1-8425-ab36196e3ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:25.369909 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf9cfb-3cc2-4fa1-8425-ab36196e3ddf None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:25.370194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf9cfb-3cc2-4fa1-8425-ab36196e3ddf None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:25.370469 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf9cfb-3cc2-4fa1-8425-ab36196e3ddf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:25.379261 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf9cfb-3cc2-4fa1-8425-ab36196e3ddf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:25.380740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf9cfb-3cc2-4fa1-8425-ab36196e3ddf None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:25.395601 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 249/501] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:25.396480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152ff1b-96f3-43b3-b67d-1dca0e8ecd0c None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-26cf9cfb-3cc2-4fa1-8425-ab36196e3ddf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:48:25.396759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:25.397581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:25.398439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:25.398439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:25.398439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:48:25.398439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:48:25.398439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:48:25.398439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:48:25.398439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:48:25.398439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:48:25.398439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:48:25.398439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:25.398439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 253/502] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:25.399001 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf9cfb-3cc2-4fa1-8425-ab36196e3ddf None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:25.418478 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:25.468967 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:25.497931 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152ff1b-96f3-43b3-b67d-1dca0e8ecd0c None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:25.510772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf9cfb-3cc2-4fa1-8425-ab36196e3ddf None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:25.537803 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff5b50-3173-4214-b716-4183acb03657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:25.538468 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff5b50-3173-4214-b716-4183acb03657 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:25.538758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff5b50-3173-4214-b716-4183acb03657 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:25.539042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff5b50-3173-4214-b716-4183acb03657 None admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:25.539879 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff5b50-3173-4214-b716-4183acb03657 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:25.540221 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff5b50-3173-4214-b716-4183acb03657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:25.541665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff5b50-3173-4214-b716-4183acb03657 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:25.547946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5c0d0-1f0f-48ee-a7a1-d49cf51f7171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:25.548691 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5c0d0-1f0f-48ee-a7a1-d49cf51f7171 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:25.548978 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5c0d0-1f0f-48ee-a7a1-d49cf51f7171 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:25.549259 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5c0d0-1f0f-48ee-a7a1-d49cf51f7171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:25.559587 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5c0d0-1f0f-48ee-a7a1-d49cf51f7171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:25.561735 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5c0d0-1f0f-48ee-a7a1-d49cf51f7171 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:25.579932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-d1b5c0d0-1f0f-48ee-a7a1-d49cf51f7171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:25.579932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:25.579932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:25.579932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:25.579932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:25.579932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:25.579932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:25.579932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:25.579932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:25.579932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:25.579932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:25.579932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:25.579932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:25.579932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:25.579932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:25.580783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:25.586688 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:25.586688 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:25.586688 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:25.586688 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:25.586688 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 254/504] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:25.586688 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5c0d0-1f0f-48ee-a7a1-d49cf51f7171 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:25.587005 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 250/504] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Jul 14 11:48:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:25.587005 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff5b50-3173-4214-b716-4183acb03657 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:25.668899 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:25.708642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff5b50-3173-4214-b716-4183acb03657 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:25.712176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5c0d0-1f0f-48ee-a7a1-d49cf51f7171 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:25.743012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:25.752724 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7957a30-2ae0-4a44-ad8c-a198c931650b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:25.753152 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed335b5-882a-4edf-adae-d37c81207d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:25.753608 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7957a30-2ae0-4a44-ad8c-a198c931650b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:25.753903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed335b5-882a-4edf-adae-d37c81207d57 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:25.754012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7957a30-2ae0-4a44-ad8c-a198c931650b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:25.754097 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed335b5-882a-4edf-adae-d37c81207d57 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:25.754298 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7957a30-2ae0-4a44-ad8c-a198c931650b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:25.754536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed335b5-882a-4edf-adae-d37c81207d57 None admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:25.755947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed335b5-882a-4edf-adae-d37c81207d57 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:25.756112 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed335b5-882a-4edf-adae-d37c81207d57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:25.757684 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed335b5-882a-4edf-adae-d37c81207d57 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:25.766089 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7957a30-2ae0-4a44-ad8c-a198c931650b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:25.767558 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7957a30-2ae0-4a44-ad8c-a198c931650b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:25.775635 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 251/505] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Jul 14 11:48:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:25.776755 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed335b5-882a-4edf-adae-d37c81207d57 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:25.787243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-a7957a30-2ae0-4a44-ad8c-a198c931650b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:25.787243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:25.787243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:25.787243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:25.787243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:25.787243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:25.787243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:25.787243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:25.787243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:25.787243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:25.787243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:25.787243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:25.787243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:25.787243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:25.787243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:25.788358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:25.789216 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:25.789216 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:25.789216 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:25.789216 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:25.789216 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 255/506] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:25.789481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7957a30-2ae0-4a44-ad8c-a198c931650b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:25.891638 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed335b5-882a-4edf-adae-d37c81207d57 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:25.893842 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7957a30-2ae0-4a44-ad8c-a198c931650b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:25.913324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:25.930658 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab7e7c-d391-4a74-a480-ffc4f13b76a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:25.931668 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab7e7c-d391-4a74-a480-ffc4f13b76a4 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:25.932057 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab7e7c-d391-4a74-a480-ffc4f13b76a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:25.932339 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab7e7c-d391-4a74-a480-ffc4f13b76a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:25.932429 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5d433-2035-4d61-82af-52f8afd6bc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:25.933054 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5d433-2035-4d61-82af-52f8afd6bc61 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:25.933340 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5d433-2035-4d61-82af-52f8afd6bc61 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:25.933619 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5d433-2035-4d61-82af-52f8afd6bc61 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:25.934333 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5d433-2035-4d61-82af-52f8afd6bc61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:25.934834 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5d433-2035-4d61-82af-52f8afd6bc61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:25.936893 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5d433-2035-4d61-82af-52f8afd6bc61 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:25.948250 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 256/507] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:25.949050 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5d433-2035-4d61-82af-52f8afd6bc61 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:25.993030 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:26.006659 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab7e7c-d391-4a74-a480-ffc4f13b76a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:26.008157 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab7e7c-d391-4a74-a480-ffc4f13b76a4 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:26.047188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5d433-2035-4d61-82af-52f8afd6bc61 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:26.082225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bffc8-56c5-4374-8da8-0925fb7dbe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:26.082864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bffc8-56c5-4374-8da8-0925fb7dbe29 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:26.083148 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bffc8-56c5-4374-8da8-0925fb7dbe29 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:26.083425 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bffc8-56c5-4374-8da8-0925fb7dbe29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:26.116206 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 252/508] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:26.117234 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab7e7c-d391-4a74-a480-ffc4f13b76a4 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:26.129592 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:26.153204 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bffc8-56c5-4374-8da8-0925fb7dbe29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:26.154617 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bffc8-56c5-4374-8da8-0925fb7dbe29 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:26.209221 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:26.222637 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab7e7c-d391-4a74-a480-ffc4f13b76a4 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:26.257213 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b83e3-5fd3-4258-8ff9-1c362d3e4290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:26.257880 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b83e3-5fd3-4258-8ff9-1c362d3e4290 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:26.258173 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b83e3-5fd3-4258-8ff9-1c362d3e4290 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:26.258458 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b83e3-5fd3-4258-8ff9-1c362d3e4290 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:26.259180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b83e3-5fd3-4258-8ff9-1c362d3e4290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:26.259493 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b83e3-5fd3-4258-8ff9-1c362d3e4290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:26.260585 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 257/509] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:26.260938 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b83e3-5fd3-4258-8ff9-1c362d3e4290 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:26.261489 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bffc8-56c5-4374-8da8-0925fb7dbe29 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:26.273445 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 253/510] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:26.274299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b83e3-5fd3-4258-8ff9-1c362d3e4290 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:26.338729 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:26.362431 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bffc8-56c5-4374-8da8-0925fb7dbe29 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:26.375308 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b83e3-5fd3-4258-8ff9-1c362d3e4290 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:26.395430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0492e-7dcf-42cf-8cf9-3cf280ee6d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:26.396248 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0492e-7dcf-42cf-8cf9-3cf280ee6d16 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:26.396533 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0492e-7dcf-42cf-8cf9-3cf280ee6d16 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:26.396809 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0492e-7dcf-42cf-8cf9-3cf280ee6d16 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:26.403736 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0492e-7dcf-42cf-8cf9-3cf280ee6d16 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:26.405770 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0492e-7dcf-42cf-8cf9-3cf280ee6d16 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:26.408756 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cd717-b98e-43c0-88ea-d7c3095126f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:26.409540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cd717-b98e-43c0-88ea-d7c3095126f2 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:26.409825 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cd717-b98e-43c0-88ea-d7c3095126f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:26.410105 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cd717-b98e-43c0-88ea-d7c3095126f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-41b0492e-7dcf-42cf-8cf9-3cf280ee6d16 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:48:26.420052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:26.421065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:26.421962 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:26.421962 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:26.421962 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:48:26.421962 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:48:26.421962 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:48:26.421962 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:48:26.421962 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:48:26.421962 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:48:26.421962 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:48:26.421962 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:26.423039 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864cd717-b98e-43c0-88ea-d7c3095126f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:26.423119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 258/511] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:48:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:26.423194 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864cd717-b98e-43c0-88ea-d7c3095126f2 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:26.423286 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0492e-7dcf-42cf-8cf9-3cf280ee6d16 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:26.433794 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:26.443838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-864cd717-b98e-43c0-88ea-d7c3095126f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:26.443838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:26.443838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:26.443838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:26.443838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:26.443838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:26.443838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:26.443838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:26.443838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:26.443838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:26.443838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:26.443838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:26.443838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:26.443838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:26.443838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:26.444680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:26.445998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:26.445998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:26.445998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:26.445998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:26.445998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 254/512] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:26.446490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cd717-b98e-43c0-88ea-d7c3095126f2 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:26.526960 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0492e-7dcf-42cf-8cf9-3cf280ee6d16 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:26.545149 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cd717-b98e-43c0-88ea-d7c3095126f2 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:26.559718 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad2285-143d-4a2c-8d6f-671be90d77fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:26.560533 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad2285-143d-4a2c-8d6f-671be90d77fd None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:26.560822 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad2285-143d-4a2c-8d6f-671be90d77fd None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:26.561104 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad2285-143d-4a2c-8d6f-671be90d77fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:26.564342 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:26.572697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad2285-143d-4a2c-8d6f-671be90d77fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:26.574149 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad2285-143d-4a2c-8d6f-671be90d77fd None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:26.579707 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f7c9e-1e59-4b22-a8dd-3f07fa6de41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:26.580526 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f7c9e-1e59-4b22-a8dd-3f07fa6de41a None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:26.580812 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f7c9e-1e59-4b22-a8dd-3f07fa6de41a None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:26.581089 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f7c9e-1e59-4b22-a8dd-3f07fa6de41a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:26.587725 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f7c9e-1e59-4b22-a8dd-3f07fa6de41a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:26.589179 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f7c9e-1e59-4b22-a8dd-3f07fa6de41a None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:26.592694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-98ad2285-143d-4a2c-8d6f-671be90d77fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:26.592694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:26.592694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:26.592694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:26.592694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:26.592694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:26.592694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:26.592694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:26.592694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:26.592694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:26.592694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:26.592694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:26.592694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:26.592694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:26.592694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:26.593530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:26.594345 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:26.594345 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:26.594345 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:26.594345 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:26.594345 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 259/513] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:26.594872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad2285-143d-4a2c-8d6f-671be90d77fd None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:26.604175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-749f7c9e-1e59-4b22-a8dd-3f07fa6de41a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:26.604175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:26.604175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:26.604175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:26.604175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:26.604175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:26.604175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:26.604175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:26.604175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:26.604175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:26.604175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:26.604175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:26.604175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:48:26.604175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:48:26.604175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:26.604994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:26.605826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:48:26.605826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:48:26.605826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:48:26.605826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:48:26.605826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:48:26.605826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:48:26.605826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:26.605826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:26.605826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 255/514] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:26.606297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f7c9e-1e59-4b22-a8dd-3f07fa6de41a None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:26.669610 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:26.697237 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad2285-143d-4a2c-8d6f-671be90d77fd None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:26.710778 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f7c9e-1e59-4b22-a8dd-3f07fa6de41a None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:26.730115 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086889c-61d6-4892-a59e-62a234125bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:26.730779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086889c-61d6-4892-a59e-62a234125bb9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:26.731064 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086889c-61d6-4892-a59e-62a234125bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:26.731348 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086889c-61d6-4892-a59e-62a234125bb9 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:26.732205 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086889c-61d6-4892-a59e-62a234125bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:26.732517 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086889c-61d6-4892-a59e-62a234125bb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:26.734172 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086889c-61d6-4892-a59e-62a234125bb9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:26.744812 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbefd04-6124-480b-b281-583997a875e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:26.745471 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbefd04-6124-480b-b281-583997a875e8 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:26.745755 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbefd04-6124-480b-b281-583997a875e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:26.746032 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbefd04-6124-480b-b281-583997a875e8 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:26.746742 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbefd04-6124-480b-b281-583997a875e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:26.747051 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbefd04-6124-480b-b281-583997a875e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:26.748446 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbefd04-6124-480b-b281-583997a875e8 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:26.751505 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 260/515] 10.222.0.49 () {56 vars in 1139 bytes} [Thu Jul 14 11:48:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:26.752332 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086889c-61d6-4892-a59e-62a234125bb9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:26.761258 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 256/516] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:26.762117 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbefd04-6124-480b-b281-583997a875e8 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:26.802979 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:26.855178 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086889c-61d6-4892-a59e-62a234125bb9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:26.863972 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbefd04-6124-480b-b281-583997a875e8 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:26.883560 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:26.889519 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4bcae-d0c3-4ddd-875e-4f38367e62bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:26.890745 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4bcae-d0c3-4ddd-875e-4f38367e62bd None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:26.891031 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4bcae-d0c3-4ddd-875e-4f38367e62bd None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:26.891315 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4bcae-d0c3-4ddd-875e-4f38367e62bd None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:26.892063 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4bcae-d0c3-4ddd-875e-4f38367e62bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:26.892379 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4bcae-d0c3-4ddd-875e-4f38367e62bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:26.893759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4bcae-d0c3-4ddd-875e-4f38367e62bd None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:26.898748 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42595955-026f-4cd6-911c-32b2418d45df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:26.899401 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42595955-026f-4cd6-911c-32b2418d45df None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:26.899697 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42595955-026f-4cd6-911c-32b2418d45df None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:26.900011 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42595955-026f-4cd6-911c-32b2418d45df None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:26.900789 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42595955-026f-4cd6-911c-32b2418d45df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:26.901101 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42595955-026f-4cd6-911c-32b2418d45df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:26.902539 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42595955-026f-4cd6-911c-32b2418d45df None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:26.904792 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 261/517] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:26.906211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4bcae-d0c3-4ddd-875e-4f38367e62bd None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:26.921819 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 257/518] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:48:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:26.922602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42595955-026f-4cd6-911c-32b2418d45df None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:27.012536 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4bcae-d0c3-4ddd-875e-4f38367e62bd None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:27.020315 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:27.022676 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42595955-026f-4cd6-911c-32b2418d45df None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:27.048046 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9c4b4-d03c-4022-95d0-dbf59e2a7b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:27.048690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9c4b4-d03c-4022-95d0-dbf59e2a7b0b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:27.048986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9c4b4-d03c-4022-95d0-dbf59e2a7b0b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:27.049256 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9c4b4-d03c-4022-95d0-dbf59e2a7b0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:27.056964 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10206a7c-4f1a-4240-9e12-3339d1c8e1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:27.057791 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10206a7c-4f1a-4240-9e12-3339d1c8e1dc None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:27.058113 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10206a7c-4f1a-4240-9e12-3339d1c8e1dc None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:27.058428 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10206a7c-4f1a-4240-9e12-3339d1c8e1dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:27.065687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10206a7c-4f1a-4240-9e12-3339d1c8e1dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:27.067139 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10206a7c-4f1a-4240-9e12-3339d1c8e1dc None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:27.081223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-10206a7c-4f1a-4240-9e12-3339d1c8e1dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:27.081223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:27.081223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:27.081223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:27.081223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:27.081223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:27.081223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:27.081223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:27.081223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:27.081223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:27.081223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:27.081223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:27.081223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:48:27.081223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:48:27.081223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:27.082222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:27.083262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:48:27.083262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:48:27.083262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:48:27.083262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:48:27.083262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:48:27.083262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:48:27.083262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:27.083262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:27.083262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 258/519] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:27.083262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10206a7c-4f1a-4240-9e12-3339d1c8e1dc None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:27.119965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9c4b4-d03c-4022-95d0-dbf59e2a7b0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:27.121448 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9c4b4-d03c-4022-95d0-dbf59e2a7b0b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:27.128860 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:27.193563 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10206a7c-4f1a-4240-9e12-3339d1c8e1dc None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:27.227760 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 262/520] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:27.228645 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9c4b4-d03c-4022-95d0-dbf59e2a7b0b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:27.235741 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4e13b-2191-47be-8c98-5c602282be62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:27.236770 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4e13b-2191-47be-8c98-5c602282be62 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:27.237060 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4e13b-2191-47be-8c98-5c602282be62 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:27.237411 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:27.238044 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4e13b-2191-47be-8c98-5c602282be62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:27.247931 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4e13b-2191-47be-8c98-5c602282be62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:27.250292 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4e13b-2191-47be-8c98-5c602282be62 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:27.268877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-37e4e13b-2191-47be-8c98-5c602282be62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:27.268877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:27.268877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:27.268877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:27.268877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:27.268877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:27.268877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:27.268877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:27.268877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:27.268877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:27.268877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:27.268877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:27.268877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:48:27.268877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:48:27.268877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:27.269891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:27.270751 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:48:27.270751 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:48:27.270751 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:48:27.270751 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:48:27.270751 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:48:27.270751 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:48:27.270751 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:27.270751 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:27.270751 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 259/521] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:27.271217 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4e13b-2191-47be-8c98-5c602282be62 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:27.331468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9c4b4-d03c-4022-95d0-dbf59e2a7b0b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:27.365598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2599b2-0607-43ce-aad7-3f7ebf0238e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:27.366257 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2599b2-0607-43ce-aad7-3f7ebf0238e1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:27.366549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2599b2-0607-43ce-aad7-3f7ebf0238e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:27.366837 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2599b2-0607-43ce-aad7-3f7ebf0238e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:27.367667 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2599b2-0607-43ce-aad7-3f7ebf0238e1 None admin] RBAC: Adding query filter params (role.id=7ae76d85b6364363960c2e6fc20bc78a, scope.project.id=b711bbd57a5446a39ee7c2cf96356083, user.id=6fd8e197398e465aa3247d2ea89430d8) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:27.368021 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2599b2-0607-43ce-aad7-3f7ebf0238e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:27.369259 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:27.369468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2599b2-0607-43ce-aad7-3f7ebf0238e1 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:27.371980 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4e13b-2191-47be-8c98-5c602282be62 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:27.375171 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 263/522] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:48:27 2022] GET /identity/v3/role_assignments?user.id=6fd8e197398e465aa3247d2ea89430d8&scope.project.id=b711bbd57a5446a39ee7c2cf96356083&role.id=7ae76d85b6364363960c2e6fc20bc78a => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:27.375995 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2599b2-0607-43ce-aad7-3f7ebf0238e1 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:27.422312 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b85b3-265d-404b-b810-8e13593097bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:27.423726 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b85b3-265d-404b-b810-8e13593097bb None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:27.424061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b85b3-265d-404b-b810-8e13593097bb None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:27.424348 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b85b3-265d-404b-b810-8e13593097bb None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:27.425573 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b85b3-265d-404b-b810-8e13593097bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:27.425573 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b85b3-265d-404b-b810-8e13593097bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:27.426953 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b85b3-265d-404b-b810-8e13593097bb None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:27.446116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 260/523] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:48:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:27.446116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b85b3-265d-404b-b810-8e13593097bb None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:27.467248 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:27.502833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2599b2-0607-43ce-aad7-3f7ebf0238e1 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:27.541073 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b27fe1-8ab5-4414-af59-99dc26d76030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:27.542074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b27fe1-8ab5-4414-af59-99dc26d76030 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:27.542219 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b27fe1-8ab5-4414-af59-99dc26d76030 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:27.542438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b27fe1-8ab5-4414-af59-99dc26d76030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:27.559275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b27fe1-8ab5-4414-af59-99dc26d76030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:27.561612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b27fe1-8ab5-4414-af59-99dc26d76030 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:27.574625 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b85b3-265d-404b-b810-8e13593097bb None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:27.584012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-42b27fe1-8ab5-4414-af59-99dc26d76030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:27.584012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:27.584012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:27.584012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:27.584012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:27.584012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:27.584012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:27.584012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:27.584012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:27.584012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:27.584012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:27.584012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:27.584012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:27.584012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:27.584012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:27.584859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:27.585839 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:27.585839 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:27.585839 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:27.585839 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:27.585839 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 264/524] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:27.586113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b27fe1-8ab5-4414-af59-99dc26d76030 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:27.618597 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b0509-55a2-4069-935a-88e2aead63ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:27.619261 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b0509-55a2-4069-935a-88e2aead63ed None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:27.619550 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b0509-55a2-4069-935a-88e2aead63ed None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:27.619826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b0509-55a2-4069-935a-88e2aead63ed None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:27.620644 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b0509-55a2-4069-935a-88e2aead63ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:27.620958 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b0509-55a2-4069-935a-88e2aead63ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:27.622389 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b0509-55a2-4069-935a-88e2aead63ed None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:27.639972 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 261/525] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:48:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:27.639972 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b0509-55a2-4069-935a-88e2aead63ed None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:27.660312 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:27.704970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b27fe1-8ab5-4414-af59-99dc26d76030 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:27.731720 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:27.745786 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d58d80-80a6-4c5d-ba31-9171b1ca6c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:27.746455 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d58d80-80a6-4c5d-ba31-9171b1ca6c04 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:27.746746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d58d80-80a6-4c5d-ba31-9171b1ca6c04 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:27.747076 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d58d80-80a6-4c5d-ba31-9171b1ca6c04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:27.747725 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b0509-55a2-4069-935a-88e2aead63ed None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:27.747958 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d58d80-80a6-4c5d-ba31-9171b1ca6c04 None admin] RBAC: Adding query filter params (role.id=7ae76d85b6364363960c2e6fc20bc78a, scope.project.id=b711bbd57a5446a39ee7c2cf96356083, user.id=2ac098792b924ce887b3e3abfe596c8d) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:27.748282 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d58d80-80a6-4c5d-ba31-9171b1ca6c04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:27.749738 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d58d80-80a6-4c5d-ba31-9171b1ca6c04 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:27.763926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 265/526] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:48:27 2022] GET /identity/v3/role_assignments?user.id=2ac098792b924ce887b3e3abfe596c8d&scope.project.id=b711bbd57a5446a39ee7c2cf96356083&role.id=7ae76d85b6364363960c2e6fc20bc78a => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:27.763926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d58d80-80a6-4c5d-ba31-9171b1ca6c04 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:27.805204 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cca81c-5fd3-4a4d-9a2b-d789184263e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:27.806481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cca81c-5fd3-4a4d-9a2b-d789184263e1 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:27.806770 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cca81c-5fd3-4a4d-9a2b-d789184263e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:27.807048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cca81c-5fd3-4a4d-9a2b-d789184263e1 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:27.807782 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cca81c-5fd3-4a4d-9a2b-d789184263e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:27.808310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cca81c-5fd3-4a4d-9a2b-d789184263e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:27.809779 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cca81c-5fd3-4a4d-9a2b-d789184263e1 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:27.824263 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 262/527] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:27.830702 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cca81c-5fd3-4a4d-9a2b-d789184263e1 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:27.890653 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d58d80-80a6-4c5d-ba31-9171b1ca6c04 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:27.936769 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d6420-74cf-4846-aabb-02cddfe6354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:27.937174 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d6420-74cf-4846-aabb-02cddfe6354f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:27.937472 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d6420-74cf-4846-aabb-02cddfe6354f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:27.937889 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d6420-74cf-4846-aabb-02cddfe6354f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:27.938730 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:27.940786 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d6420-74cf-4846-aabb-02cddfe6354f None admin] RBAC: Adding query filter params (role.id=7ae76d85b6364363960c2e6fc20bc78a, scope.project.id=b711bbd57a5446a39ee7c2cf96356083, user.id=ab858f5998b348ecbac54423716b7671) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:27.941685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d6420-74cf-4846-aabb-02cddfe6354f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:27.944103 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d6420-74cf-4846-aabb-02cddfe6354f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:27.954627 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 266/528] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:48:27 2022] GET /identity/v3/role_assignments?user.id=ab858f5998b348ecbac54423716b7671&scope.project.id=b711bbd57a5446a39ee7c2cf96356083&role.id=7ae76d85b6364363960c2e6fc20bc78a => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:27.968006 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cca81c-5fd3-4a4d-9a2b-d789184263e1 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:28.006426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb29b2-cd8d-4faf-850f-15fc66e45fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:28.007384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb29b2-cd8d-4faf-850f-15fc66e45fc2 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:28.007786 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb29b2-cd8d-4faf-850f-15fc66e45fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:28.008205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb29b2-cd8d-4faf-850f-15fc66e45fc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:28.016563 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb29b2-cd8d-4faf-850f-15fc66e45fc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:28.018223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb29b2-cd8d-4faf-850f-15fc66e45fc2 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:28.035027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-dffb29b2-cd8d-4faf-850f-15fc66e45fc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:28.035027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:28.035027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:28.035027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:28.035027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:28.035027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:28.035027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:28.035027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:28.035027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:28.035027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:28.035027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:28.035027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:28.035027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:48:28.035027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:48:28.035027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:28.035942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:28.036760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:48:28.036760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:48:28.036760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:48:28.036760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:48:28.036760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:48:28.036760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:48:28.036760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:28.036760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:28.036760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 263/529] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:28.045092 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d6420-74cf-4846-aabb-02cddfe6354f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:28.106003 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:28.164200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d6420-74cf-4846-aabb-02cddfe6354f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:28.208360 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df488d68-79c8-4952-bdd6-e00c0243aa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:28.209379 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df488d68-79c8-4952-bdd6-e00c0243aa0a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:28.209893 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df488d68-79c8-4952-bdd6-e00c0243aa0a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:28.210397 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df488d68-79c8-4952-bdd6-e00c0243aa0a None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:28.211397 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df488d68-79c8-4952-bdd6-e00c0243aa0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:28.211930 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df488d68-79c8-4952-bdd6-e00c0243aa0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:28.213577 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df488d68-79c8-4952-bdd6-e00c0243aa0a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:28.232967 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 267/530] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:48:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:28.240968 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb29b2-cd8d-4faf-850f-15fc66e45fc2 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:28.348739 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb29b2-cd8d-4faf-850f-15fc66e45fc2 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:28.384760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413fc38-2d66-4cf3-8754-4df643d84081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:28.385418 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413fc38-2d66-4cf3-8754-4df643d84081 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:28.385706 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413fc38-2d66-4cf3-8754-4df643d84081 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:28.385988 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413fc38-2d66-4cf3-8754-4df643d84081 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:28.386821 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413fc38-2d66-4cf3-8754-4df643d84081 None admin] RBAC: Adding query filter params (role.id=7ae76d85b6364363960c2e6fc20bc78a, scope.project.id=b711bbd57a5446a39ee7c2cf96356083, user.id=336c852c9dfb4c6a8ee62134c2ff32ef) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:28.387136 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413fc38-2d66-4cf3-8754-4df643d84081 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:28.388616 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413fc38-2d66-4cf3-8754-4df643d84081 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:28.400022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 264/531] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:48:28 2022] GET /identity/v3/role_assignments?user.id=336c852c9dfb4c6a8ee62134c2ff32ef&scope.project.id=b711bbd57a5446a39ee7c2cf96356083&role.id=7ae76d85b6364363960c2e6fc20bc78a => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:29.710523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0eb631-72fd-45fb-a4eb-2d752c52332f None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:29.711610 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0eb631-72fd-45fb-a4eb-2d752c52332f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:29.712162 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0eb631-72fd-45fb-a4eb-2d752c52332f None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:29.713969 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 268/532] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:29.719712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0f5bf-823c-4008-a46a-abb62a2f7e5b None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:29.721144 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0f5bf-823c-4008-a46a-abb62a2f7e5b None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:29.721636 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0f5bf-823c-4008-a46a-abb62a2f7e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:29.728159 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:29.740792 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-21e0f5bf-823c-4008-a46a-abb62a2f7e5b None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:29.742296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-21e0f5bf-823c-4008-a46a-abb62a2f7e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:29.819738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 265/533] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:29.843719 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0eb631-72fd-45fb-a4eb-2d752c52332f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:29.958135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0eb631-72fd-45fb-a4eb-2d752c52332f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:29.970170 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:29.997068 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d86e96-ec42-4742-9386-746758b8659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:29.998321 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86e96-ec42-4742-9386-746758b8659d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:29.998817 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86e96-ec42-4742-9386-746758b8659d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:29.999290 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86e96-ec42-4742-9386-746758b8659d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:30.012145 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d86e96-ec42-4742-9386-746758b8659d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-21d86e96-ec42-4742-9386-746758b8659d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:30.020923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:30.021851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:30.022675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:30.022675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:30.022675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:30.022675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:30.022675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:30.022675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:30.022675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:30.022675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:30.022675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:30.022675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:30.022675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:30.022675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:30.025419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 269/534] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:48:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:30.033011 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0f5bf-823c-4008-a46a-abb62a2f7e5b None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:30.092205 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eba546-f0bf-4bc9-b933-1d167ea706d3 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:30.092844 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eba546-f0bf-4bc9-b933-1d167ea706d3 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:30.093331 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eba546-f0bf-4bc9-b933-1d167ea706d3 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:30.095238 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 270/535] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:48:30.100477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1230ce-1dd1-4b61-a1c9-49685fded9ea None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:30.100775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1230ce-1dd1-4b61-a1c9-49685fded9ea None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:30.101055 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1230ce-1dd1-4b61-a1c9-49685fded9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:30.119479 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ed1230ce-1dd1-4b61-a1c9-49685fded9ea None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:30.120726 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ed1230ce-1dd1-4b61-a1c9-49685fded9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:30.152397 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0f5bf-823c-4008-a46a-abb62a2f7e5b None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:30.202583 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db63dff-7372-4638-bb2a-a59beb789de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:30.203604 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db63dff-7372-4638-bb2a-a59beb789de7 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:30.204287 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db63dff-7372-4638-bb2a-a59beb789de7 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:30.204735 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db63dff-7372-4638-bb2a-a59beb789de7 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:30.206932 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db63dff-7372-4638-bb2a-a59beb789de7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:30.207447 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db63dff-7372-4638-bb2a-a59beb789de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:30.208334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 271/536] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:48:30.209280 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db63dff-7372-4638-bb2a-a59beb789de7 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:30.219015 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 266/537] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 14 11:48:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:30.219546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:30.226619 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1230ce-1dd1-4b61-a1c9-49685fded9ea None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:30.235942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db63dff-7372-4638-bb2a-a59beb789de7 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:30.355741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:30.359741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1230ce-1dd1-4b61-a1c9-49685fded9ea None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:30.376050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db63dff-7372-4638-bb2a-a59beb789de7 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:30.403069 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19109be-341a-4649-bf8d-e330666ba46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:30.403870 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19109be-341a-4649-bf8d-e330666ba46b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:30.404188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19109be-341a-4649-bf8d-e330666ba46b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:30.404474 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19109be-341a-4649-bf8d-e330666ba46b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:30.412441 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf859cfd-3ccc-4ec9-aae1-b7ef8f8a4c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:30.413696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf859cfd-3ccc-4ec9-aae1-b7ef8f8a4c5a None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:30.413987 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf859cfd-3ccc-4ec9-aae1-b7ef8f8a4c5a None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:30.414496 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf859cfd-3ccc-4ec9-aae1-b7ef8f8a4c5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:30.415244 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19109be-341a-4649-bf8d-e330666ba46b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:30.416757 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19109be-341a-4649-bf8d-e330666ba46b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:30.425265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf859cfd-3ccc-4ec9-aae1-b7ef8f8a4c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-cf859cfd-3ccc-4ec9-aae1-b7ef8f8a4c5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:30.433224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:30.434072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:30.435268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:30.435268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:30.435268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:30.435268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:30.435268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:30.435268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:30.435268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:30.435268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:30.435268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:30.435268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:30.435268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:30.435268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:30.435268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 267/538] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:48:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:30.436298 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c75441-3856-4742-8f6b-bfdd95d3b12f None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:30.436298 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c75441-3856-4742-8f6b-bfdd95d3b12f None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:30.436533 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c75441-3856-4742-8f6b-bfdd95d3b12f None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:30.437924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 268/539] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:30.440434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-b19109be-341a-4649-bf8d-e330666ba46b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:30.440434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:30.440434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:30.440434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:30.440434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:30.440434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:30.440434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:30.440434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:30.440434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:30.440434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:30.440434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:30.440434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:30.440434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:30.440434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:30.440434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:30.441258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:30.442563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:30.442563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:30.442563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:30.442563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:30.442563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 272/540] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:30.443398 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c75441-3856-4742-8f6b-bfdd95d3b12f None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:30.445336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1549f5f-7f97-40da-9a86-83f9e153c25a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:30.445698 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1549f5f-7f97-40da-9a86-83f9e153c25a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:30.446043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1549f5f-7f97-40da-9a86-83f9e153c25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:30.463457 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-f1549f5f-7f97-40da-9a86-83f9e153c25a None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:30.464683 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f1549f5f-7f97-40da-9a86-83f9e153c25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:30.507546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:30.537624 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 273/541] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:30.538947 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1549f5f-7f97-40da-9a86-83f9e153c25a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:30.564411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c75441-3856-4742-8f6b-bfdd95d3b12f None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:30.607935 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5919c2-62f2-474a-bad7-da5d0759a03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:30.611045 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5919c2-62f2-474a-bad7-da5d0759a03b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:30.611045 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5919c2-62f2-474a-bad7-da5d0759a03b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:30.611045 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5919c2-62f2-474a-bad7-da5d0759a03b None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:30.611045 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5919c2-62f2-474a-bad7-da5d0759a03b None admin] RBAC: Adding query filter params (name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:30.611045 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5919c2-62f2-474a-bad7-da5d0759a03b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:30.612792 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5919c2-62f2-474a-bad7-da5d0759a03b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:30.626203 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 269/542] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 14 11:48:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:30.627308 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5919c2-62f2-474a-bad7-da5d0759a03b None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:30.643652 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:30.664956 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1549f5f-7f97-40da-9a86-83f9e153c25a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:30.706665 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42ac9e-6b3d-4ece-bf85-a88646994222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:30.707633 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42ac9e-6b3d-4ece-bf85-a88646994222 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:30.707949 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42ac9e-6b3d-4ece-bf85-a88646994222 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:30.708328 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42ac9e-6b3d-4ece-bf85-a88646994222 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:30.709064 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42ac9e-6b3d-4ece-bf85-a88646994222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:30.709380 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42ac9e-6b3d-4ece-bf85-a88646994222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:30.711441 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42ac9e-6b3d-4ece-bf85-a88646994222 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:30.723222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 274/543] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:30.724117 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42ac9e-6b3d-4ece-bf85-a88646994222 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:30.735086 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5919c2-62f2-474a-bad7-da5d0759a03b None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:30.752558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:30.770895 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9d3b6-d98e-4b97-a707-fab065014897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:30.771628 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9d3b6-d98e-4b97-a707-fab065014897 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:30.771949 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9d3b6-d98e-4b97-a707-fab065014897 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:30.772236 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9d3b6-d98e-4b97-a707-fab065014897 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:30.782337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9d3b6-d98e-4b97-a707-fab065014897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-eec9d3b6-d98e-4b97-a707-fab065014897 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:30.790310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:30.791207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:30.792022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:30.792022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:30.792022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:30.792022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:30.792022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:30.792022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:30.792022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:30.792022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:30.792022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:30.792022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:30.792022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:30.792022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:30.792022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 270/544] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:48:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:30.792835 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e460f-bead-4de5-bdbc-675e4b731385 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:30.793022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e460f-bead-4de5-bdbc-675e4b731385 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:30.793283 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e460f-bead-4de5-bdbc-675e4b731385 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:30.794539 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 271/545] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:30.795231 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e460f-bead-4de5-bdbc-675e4b731385 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:30.833095 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42ac9e-6b3d-4ece-bf85-a88646994222 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:30.866014 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b41bdd-7912-4b95-b5db-42b133ae8a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:30.866838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b41bdd-7912-4b95-b5db-42b133ae8a0c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:30.867124 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b41bdd-7912-4b95-b5db-42b133ae8a0c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:30.867398 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b41bdd-7912-4b95-b5db-42b133ae8a0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:30.878575 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b41bdd-7912-4b95-b5db-42b133ae8a0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:30.880064 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b41bdd-7912-4b95-b5db-42b133ae8a0c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:30.881758 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:30.898518 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e460f-bead-4de5-bdbc-675e4b731385 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:30.898780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-b0b41bdd-7912-4b95-b5db-42b133ae8a0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:30.898780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:30.898780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:30.898780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:30.898780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:30.898780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:30.898780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:30.898780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:30.898780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:30.898780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:30.898780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:30.898780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:30.898780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:30.898780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:30.898780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:30.899574 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:30.900475 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:30.900475 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:30.900475 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:30.900475 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:30.900475 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 275/546] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:30.900777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b41bdd-7912-4b95-b5db-42b133ae8a0c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:30.934731 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0b2fc-4cbd-4878-ace2-373297c1fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:30.935522 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0b2fc-4cbd-4878-ace2-373297c1fca2 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:30.935809 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0b2fc-4cbd-4878-ace2-373297c1fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:30.936120 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0b2fc-4cbd-4878-ace2-373297c1fca2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:30.944268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0b2fc-4cbd-4878-ace2-373297c1fca2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:30.945711 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0b2fc-4cbd-4878-ace2-373297c1fca2 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-7ea0b2fc-4cbd-4878-ace2-373297c1fca2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:48:30.959402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:30.960495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:30.961359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:30.961359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:30.961359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:48:30.961359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:48:30.961359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:48:30.961359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:48:30.961359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:48:30.961359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:48:30.961359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:48:30.961359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:30.961359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 272/547] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Jul 14 11:48:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:30.961921 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1b9fc-1881-4516-8ff8-60ce167b46d7 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:30.962099 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1b9fc-1881-4516-8ff8-60ce167b46d7 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:30.962364 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1b9fc-1881-4516-8ff8-60ce167b46d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:30.978754 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-c2e1b9fc-1881-4516-8ff8-60ce167b46d7 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:30.979978 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-c2e1b9fc-1881-4516-8ff8-60ce167b46d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:31.004406 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b41bdd-7912-4b95-b5db-42b133ae8a0c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:31.010873 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:31.038650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3d45f-dd6d-4539-8cbf-72ce507f8297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:31.039246 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3d45f-dd6d-4539-8cbf-72ce507f8297 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:31.039534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3d45f-dd6d-4539-8cbf-72ce507f8297 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:31.039818 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3d45f-dd6d-4539-8cbf-72ce507f8297 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:31.040608 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3d45f-dd6d-4539-8cbf-72ce507f8297 None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:31.040921 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3d45f-dd6d-4539-8cbf-72ce507f8297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:31.042311 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3d45f-dd6d-4539-8cbf-72ce507f8297 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:31.050908 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 273/548] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:31.051053 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 276/549] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 14 11:48:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:31.056388 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1b9fc-1881-4516-8ff8-60ce167b46d7 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:31.056521 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3d45f-dd6d-4539-8cbf-72ce507f8297 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:31.111323 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:31.155787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3d45f-dd6d-4539-8cbf-72ce507f8297 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:31.161161 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1b9fc-1881-4516-8ff8-60ce167b46d7 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:31.190144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce73918-5348-4cad-9393-c93dcc97d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:31.191469 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce73918-5348-4cad-9393-c93dcc97d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:31.191773 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce73918-5348-4cad-9393-c93dcc97d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:31.192070 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce73918-5348-4cad-9393-c93dcc97d9f4 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:31.194110 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce73918-5348-4cad-9393-c93dcc97d9f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:31.195859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce73918-5348-4cad-9393-c93dcc97d9f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:31.198443 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce73918-5348-4cad-9393-c93dcc97d9f4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:31.200116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c53ce-37fb-4f08-b683-59baaceb8da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:31.200777 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c53ce-37fb-4f08-b683-59baaceb8da9 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:31.201062 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c53ce-37fb-4f08-b683-59baaceb8da9 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:31.201336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c53ce-37fb-4f08-b683-59baaceb8da9 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:31.202050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c53ce-37fb-4f08-b683-59baaceb8da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:31.202359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c53ce-37fb-4f08-b683-59baaceb8da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:31.203707 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c53ce-37fb-4f08-b683-59baaceb8da9 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:31.216329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 274/550] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:31.220863 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 277/551] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Jul 14 11:48:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:31.220995 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c53ce-37fb-4f08-b683-59baaceb8da9 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:31.221102 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce73918-5348-4cad-9393-c93dcc97d9f4 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:31.249339 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:31.321294 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c53ce-37fb-4f08-b683-59baaceb8da9 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:31.321506 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce73918-5348-4cad-9393-c93dcc97d9f4 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:31.335732 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:31.355583 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3108bf-34fe-4579-bcec-cca346a051ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:31.356108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137f5bb-e8c7-444f-8623-81930227a2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:31.356411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3108bf-34fe-4579-bcec-cca346a051ef None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:31.356701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3108bf-34fe-4579-bcec-cca346a051ef None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:31.356892 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137f5bb-e8c7-444f-8623-81930227a2ed None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:31.356982 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3108bf-34fe-4579-bcec-cca346a051ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:31.357174 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137f5bb-e8c7-444f-8623-81930227a2ed None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:31.357447 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137f5bb-e8c7-444f-8623-81930227a2ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:31.367746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137f5bb-e8c7-444f-8623-81930227a2ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:31.367923 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3108bf-34fe-4579-bcec-cca346a051ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:31.369385 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3108bf-34fe-4579-bcec-cca346a051ef None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-7137f5bb-e8c7-444f-8623-81930227a2ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:31.375419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:31.376466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:31.377765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:31.377765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:31.377765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:31.377765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:31.377765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:31.377765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:31.377765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:31.377765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:31.377765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:31.377765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:31.377765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:31.377765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:31.377765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 278/552] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:48:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:31.377765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137f5bb-e8c7-444f-8623-81930227a2ed None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:31.391542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-9f3108bf-34fe-4579-bcec-cca346a051ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:31.391542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:31.391542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:31.391542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:31.391542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:31.391542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:31.391542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:31.391542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:31.391542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:31.391542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:31.391542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:31.391542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:31.391542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:31.391542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:31.391542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:31.392466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:31.393346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:31.393346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:31.393346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:31.393346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:31.393346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 275/553] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:31.393623 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3108bf-34fe-4579-bcec-cca346a051ef None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:31.476386 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:31.486626 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137f5bb-e8c7-444f-8623-81930227a2ed None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:31.496613 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3108bf-34fe-4579-bcec-cca346a051ef None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:31.520193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88755c1-c86c-4982-a628-7e2269c737fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:31.521128 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88755c1-c86c-4982-a628-7e2269c737fd None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:31.521486 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88755c1-c86c-4982-a628-7e2269c737fd None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:31.521773 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88755c1-c86c-4982-a628-7e2269c737fd None admin] PATH_INFO: `/v3/users/glance` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:31.529198 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88755c1-c86c-4982-a628-7e2269c737fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:31.530453 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d36a2-df67-46d7-9940-37679592a6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:31.530648 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88755c1-c86c-4982-a628-7e2269c737fd None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:31.531263 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d36a2-df67-46d7-9940-37679592a6fd None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:31.531548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d36a2-df67-46d7-9940-37679592a6fd None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:31.531826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d36a2-df67-46d7-9940-37679592a6fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:31.542746 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d36a2-df67-46d7-9940-37679592a6fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:31.544220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d36a2-df67-46d7-9940-37679592a6fd None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-e88755c1-c86c-4982-a628-7e2269c737fd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:48:31.545288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:31.546222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:31.547307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:31.547307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:31.547307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:48:31.547307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:48:31.547307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:48:31.547307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:48:31.547307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:48:31.547307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:48:31.547307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:48:31.547307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:31.547307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 279/554] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:31.547307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88755c1-c86c-4982-a628-7e2269c737fd None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:31.564472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-8d4d36a2-df67-46d7-9940-37679592a6fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:31.564472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:31.564472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:31.564472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:31.564472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:31.564472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:31.564472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:31.564472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:31.564472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:31.564472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:31.564472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:31.564472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:31.564472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:31.564472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:31.564472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:31.565369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:31.567090 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:31.567090 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:31.567090 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:31.567090 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:31.567090 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 276/555] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:31.568382 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d36a2-df67-46d7-9940-37679592a6fd None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:31.585688 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:31.652685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88755c1-c86c-4982-a628-7e2269c737fd None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:31.670028 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d36a2-df67-46d7-9940-37679592a6fd None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:31.686668 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c8858-77e1-47d7-9600-8b1d992f2d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:31.687357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c8858-77e1-47d7-9600-8b1d992f2d55 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:31.687644 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c8858-77e1-47d7-9600-8b1d992f2d55 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:31.687947 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c8858-77e1-47d7-9600-8b1d992f2d55 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:31.688689 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c8858-77e1-47d7-9600-8b1d992f2d55 None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:31.689006 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c8858-77e1-47d7-9600-8b1d992f2d55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:31.690394 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c8858-77e1-47d7-9600-8b1d992f2d55 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:31.697831 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:31.698446 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 280/556] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 14 11:48:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:31.699068 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c8858-77e1-47d7-9600-8b1d992f2d55 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:31.706340 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b84e81-9d6e-4624-aef7-3c97462666df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:31.707554 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b84e81-9d6e-4624-aef7-3c97462666df None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:31.707821 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b84e81-9d6e-4624-aef7-3c97462666df None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:31.708203 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b84e81-9d6e-4624-aef7-3c97462666df None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:31.708919 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b84e81-9d6e-4624-aef7-3c97462666df None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:31.709228 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b84e81-9d6e-4624-aef7-3c97462666df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:31.710587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b84e81-9d6e-4624-aef7-3c97462666df None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:31.723053 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 277/557] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:31.723809 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b84e81-9d6e-4624-aef7-3c97462666df None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:31.798175 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:31.804847 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c8858-77e1-47d7-9600-8b1d992f2d55 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:31.824503 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b84e81-9d6e-4624-aef7-3c97462666df None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:31.838117 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65b35c-1907-49af-92b3-f62b7c49dd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:31.838717 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65b35c-1907-49af-92b3-f62b7c49dd11 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:31.839001 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65b35c-1907-49af-92b3-f62b7c49dd11 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:31.839277 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65b35c-1907-49af-92b3-f62b7c49dd11 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:31.840126 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65b35c-1907-49af-92b3-f62b7c49dd11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:31.840435 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65b35c-1907-49af-92b3-f62b7c49dd11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:31.841855 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65b35c-1907-49af-92b3-f62b7c49dd11 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:31.858458 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 281/558] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Jul 14 11:48:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:31.858903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32a8db-293c-4861-ba01-dfe871de8e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:31.859253 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65b35c-1907-49af-92b3-f62b7c49dd11 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:31.859646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32a8db-293c-4861-ba01-dfe871de8e61 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:31.859853 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32a8db-293c-4861-ba01-dfe871de8e61 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:31.860163 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32a8db-293c-4861-ba01-dfe871de8e61 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:31.860878 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32a8db-293c-4861-ba01-dfe871de8e61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:31.861188 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32a8db-293c-4861-ba01-dfe871de8e61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:31.862548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32a8db-293c-4861-ba01-dfe871de8e61 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:31.873983 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 278/559] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:31.874786 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32a8db-293c-4861-ba01-dfe871de8e61 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:31.930697 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:31.957805 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65b35c-1907-49af-92b3-f62b7c49dd11 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:31.979022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32a8db-293c-4861-ba01-dfe871de8e61 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:31.992142 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74362822-a054-4c22-b741-9dbfb41552ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:31.992959 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74362822-a054-4c22-b741-9dbfb41552ee None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:31.993248 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74362822-a054-4c22-b741-9dbfb41552ee None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:31.993525 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74362822-a054-4c22-b741-9dbfb41552ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:32.003530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74362822-a054-4c22-b741-9dbfb41552ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:32.005049 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74362822-a054-4c22-b741-9dbfb41552ee None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:32.013083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8648b-4ba9-4046-af28-e886c360fcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:32.014238 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8648b-4ba9-4046-af28-e886c360fcfd None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:32.014521 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8648b-4ba9-4046-af28-e886c360fcfd None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:32.014800 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8648b-4ba9-4046-af28-e886c360fcfd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:32.022358 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8648b-4ba9-4046-af28-e886c360fcfd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:32.022905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-74362822-a054-4c22-b741-9dbfb41552ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:32.022905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:32.022905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:32.022905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:32.022905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:32.022905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:32.022905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:32.022905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:32.022905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:32.022905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:32.022905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:32.022905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:32.022905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:32.022905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:32.022905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:32.023799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:32.029799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:32.029799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:32.029799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:32.029799 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:32.030017 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8648b-4ba9-4046-af28-e886c360fcfd None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:32.030095 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 282/560] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:32.030095 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74362822-a054-4c22-b741-9dbfb41552ee None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:32.033004 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-5da8648b-4ba9-4046-af28-e886c360fcfd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:48:32.043271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:32.044497 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:32.045430 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:32.045430 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:32.045430 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:48:32.045430 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:48:32.045430 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:48:32.045430 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:48:32.045430 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:48:32.045430 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:48:32.045430 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:48:32.045430 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:32.045430 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 279/561] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:32.046035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8648b-4ba9-4046-af28-e886c360fcfd None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:32.132107 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74362822-a054-4c22-b741-9dbfb41552ee None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:32.144833 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8648b-4ba9-4046-af28-e886c360fcfd None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:32.157477 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:32.167050 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5013b0-2c3d-4e22-a945-1664f97dd1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:32.167848 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5013b0-2c3d-4e22-a945-1664f97dd1ca None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:32.168166 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5013b0-2c3d-4e22-a945-1664f97dd1ca None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:32.168452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5013b0-2c3d-4e22-a945-1664f97dd1ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:32.179553 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5013b0-2c3d-4e22-a945-1664f97dd1ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:32.181058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5013b0-2c3d-4e22-a945-1664f97dd1ca None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:32.182914 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e66437-8b39-4ee9-b1ee-70eb8fcfc288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:32.183704 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e66437-8b39-4ee9-b1ee-70eb8fcfc288 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:32.184023 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e66437-8b39-4ee9-b1ee-70eb8fcfc288 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:32.184305 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e66437-8b39-4ee9-b1ee-70eb8fcfc288 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:32.194288 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e66437-8b39-4ee9-b1ee-70eb8fcfc288 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:32.195748 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e66437-8b39-4ee9-b1ee-70eb8fcfc288 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:32.200970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-0a5013b0-2c3d-4e22-a945-1664f97dd1ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:32.200970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:32.200970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:32.200970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:32.200970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:32.200970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:32.200970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:32.200970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:32.200970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:32.200970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:32.200970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:32.200970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:32.200970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:32.200970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:32.200970 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:32.202028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:32.202904 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:32.202904 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:32.202904 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:32.202904 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:32.202904 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 283/562] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:32.203279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5013b0-2c3d-4e22-a945-1664f97dd1ca None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:32.215617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-41e66437-8b39-4ee9-b1ee-70eb8fcfc288 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:32.215617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:32.215617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:32.215617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:32.215617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:32.215617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:32.215617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:32.215617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:32.215617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:32.215617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:32.215617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:32.215617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:32.215617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:48:32.215617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:48:32.215617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:32.216536 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:32.217402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:48:32.217402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:48:32.217402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:48:32.217402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:48:32.217402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:48:32.217402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:48:32.217402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:32.217402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:32.217402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 280/563] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:32.217895 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e66437-8b39-4ee9-b1ee-70eb8fcfc288 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:32.265097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:32.322523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5013b0-2c3d-4e22-a945-1664f97dd1ca None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:32.325776 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e66437-8b39-4ee9-b1ee-70eb8fcfc288 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:32.357052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ac23b-984a-4136-bbc1-0779bba3c9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:32.357709 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ac23b-984a-4136-bbc1-0779bba3c9e6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:32.357997 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ac23b-984a-4136-bbc1-0779bba3c9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:32.358276 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ac23b-984a-4136-bbc1-0779bba3c9e6 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:32.358991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ac23b-984a-4136-bbc1-0779bba3c9e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:32.359300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ac23b-984a-4136-bbc1-0779bba3c9e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:32.359837 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d49f4-81d1-410f-9f74-df0ebd4a6549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:32.360525 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d49f4-81d1-410f-9f74-df0ebd4a6549 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:32.360710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ac23b-984a-4136-bbc1-0779bba3c9e6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:32.360809 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d49f4-81d1-410f-9f74-df0ebd4a6549 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:32.361075 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d49f4-81d1-410f-9f74-df0ebd4a6549 None admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:32.361905 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d49f4-81d1-410f-9f74-df0ebd4a6549 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:32.362216 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d49f4-81d1-410f-9f74-df0ebd4a6549 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:32.363653 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d49f4-81d1-410f-9f74-df0ebd4a6549 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:32.372567 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 284/564] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:32.373382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ac23b-984a-4136-bbc1-0779bba3c9e6 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:32.384131 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 281/565] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Jul 14 11:48:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:32.384758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d49f4-81d1-410f-9f74-df0ebd4a6549 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:32.417142 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:32.474521 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ac23b-984a-4136-bbc1-0779bba3c9e6 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:32.485111 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d49f4-81d1-410f-9f74-df0ebd4a6549 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:32.491249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:32.508575 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510ccc8-0201-4bc0-98e5-66235addfe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:32.509332 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510ccc8-0201-4bc0-98e5-66235addfe29 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:32.509722 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510ccc8-0201-4bc0-98e5-66235addfe29 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:32.510006 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510ccc8-0201-4bc0-98e5-66235addfe29 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:32.510716 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510ccc8-0201-4bc0-98e5-66235addfe29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:32.511022 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510ccc8-0201-4bc0-98e5-66235addfe29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:32.512435 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510ccc8-0201-4bc0-98e5-66235addfe29 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:32.519408 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0ae38-451a-497d-8ac5-c94dcd71ff93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:32.520682 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0ae38-451a-497d-8ac5-c94dcd71ff93 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:32.520962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0ae38-451a-497d-8ac5-c94dcd71ff93 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:32.521238 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0ae38-451a-497d-8ac5-c94dcd71ff93 None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:32.522004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0ae38-451a-497d-8ac5-c94dcd71ff93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:32.522312 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0ae38-451a-497d-8ac5-c94dcd71ff93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:32.523717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0ae38-451a-497d-8ac5-c94dcd71ff93 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:32.524662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 285/566] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:32.525454 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510ccc8-0201-4bc0-98e5-66235addfe29 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:32.540417 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 282/567] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:48:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:32.541234 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0ae38-451a-497d-8ac5-c94dcd71ff93 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:32.635162 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510ccc8-0201-4bc0-98e5-66235addfe29 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:32.636429 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:32.647462 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0ae38-451a-497d-8ac5-c94dcd71ff93 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:32.669745 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da37fb7-81b6-4473-a906-43c6d422aa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:32.670538 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da37fb7-81b6-4473-a906-43c6d422aa36 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:32.670823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da37fb7-81b6-4473-a906-43c6d422aa36 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:32.671097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da37fb7-81b6-4473-a906-43c6d422aa36 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:32.679044 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da37fb7-81b6-4473-a906-43c6d422aa36 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:32.680523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da37fb7-81b6-4473-a906-43c6d422aa36 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:32.682717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af33e6-0d2a-4d5a-8373-975c2b0c3fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:32.683509 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af33e6-0d2a-4d5a-8373-975c2b0c3fc6 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:32.683793 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af33e6-0d2a-4d5a-8373-975c2b0c3fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:32.684105 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af33e6-0d2a-4d5a-8373-975c2b0c3fc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:32.694548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af33e6-0d2a-4d5a-8373-975c2b0c3fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:32.696002 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af33e6-0d2a-4d5a-8373-975c2b0c3fc6 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-1da37fb7-81b6-4473-a906-43c6d422aa36 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:48:32.696354 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:32.697279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:32.698223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:32.698223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:32.698223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:48:32.698223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:48:32.698223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:48:32.698223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:48:32.698223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:48:32.698223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:48:32.698223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:48:32.698223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:32.698223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 286/568] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:48:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:32.698801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da37fb7-81b6-4473-a906-43c6d422aa36 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:32.714975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-a7af33e6-0d2a-4d5a-8373-975c2b0c3fc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:32.714975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:32.714975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:32.714975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:32.714975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:32.714975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:32.714975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:32.714975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:32.714975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:32.714975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:32.714975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:32.714975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:32.714975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:32.714975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:32.714975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:32.715863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:32.721614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:32.721614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:32.721614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:32.721614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:32.721614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 283/569] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:32.721614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af33e6-0d2a-4d5a-8373-975c2b0c3fc6 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:32.739627 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:32.799020 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da37fb7-81b6-4473-a906-43c6d422aa36 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:32.818850 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af33e6-0d2a-4d5a-8373-975c2b0c3fc6 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:32.833874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a736d7-dd18-48f7-ab4b-05fc7ac8fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:32.834673 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a736d7-dd18-48f7-ab4b-05fc7ac8fea7 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:32.834963 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a736d7-dd18-48f7-ab4b-05fc7ac8fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:32.835244 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a736d7-dd18-48f7-ab4b-05fc7ac8fea7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:32.841872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a736d7-dd18-48f7-ab4b-05fc7ac8fea7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:32.843316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a736d7-dd18-48f7-ab4b-05fc7ac8fea7 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:32.853937 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e671c-ce78-4253-a081-d18d70afc842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:32.854880 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e671c-ce78-4253-a081-d18d70afc842 None admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:32.855162 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e671c-ce78-4253-a081-d18d70afc842 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:32.855438 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e671c-ce78-4253-a081-d18d70afc842 None admin] PATH_INFO: `/v3/projects/b711bbd57a5446a39ee7c2cf96356083/users/6fd8e197398e465aa3247d2ea89430d8/roles/7ae76d85b6364363960c2e6fc20bc78a` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:32.858685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-25a736d7-dd18-48f7-ab4b-05fc7ac8fea7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:32.858685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:32.858685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:32.858685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:32.858685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:32.858685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:32.858685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:32.858685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:32.858685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:32.858685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:32.858685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:32.858685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:32.858685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:48:32.858685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:48:32.858685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:32.859541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:32.860542 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:48:32.860542 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:48:32.860542 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:48:32.860542 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:48:32.860542 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:48:32.860542 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:48:32.860542 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:32.860542 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:32.860542 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 287/570] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:32.861029 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a736d7-dd18-48f7-ab4b-05fc7ac8fea7 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:32.870152 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:32.873894 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e671c-ce78-4253-a081-d18d70afc842 None admin] RBAC: Authorizing `identity:create_grant(project_id=b711bbd57a5446a39ee7c2cf96356083, user_id=6fd8e197398e465aa3247d2ea89430d8, role_id=7ae76d85b6364363960c2e6fc20bc78a)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:32.875539 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e671c-ce78-4253-a081-d18d70afc842 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:32.888691 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 284/571] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:48:32 2022] PUT /identity/v3/projects/b711bbd57a5446a39ee7c2cf96356083/users/6fd8e197398e465aa3247d2ea89430d8/roles/7ae76d85b6364363960c2e6fc20bc78a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:48:32.889435 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e671c-ce78-4253-a081-d18d70afc842 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:32.977319 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:32.984183 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a736d7-dd18-48f7-ab4b-05fc7ac8fea7 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:33.005474 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e671c-ce78-4253-a081-d18d70afc842 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:33.022171 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce1a85-bea3-4d5c-b8ec-d7aa6880990c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:33.023003 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce1a85-bea3-4d5c-b8ec-d7aa6880990c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:33.023353 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce1a85-bea3-4d5c-b8ec-d7aa6880990c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:33.023577 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce1a85-bea3-4d5c-b8ec-d7aa6880990c None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:33.024467 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce1a85-bea3-4d5c-b8ec-d7aa6880990c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:33.024792 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce1a85-bea3-4d5c-b8ec-d7aa6880990c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:33.026292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce1a85-bea3-4d5c-b8ec-d7aa6880990c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:33.045427 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbe340-126d-4812-ace7-03ff3b45136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:33.050983 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbe340-126d-4812-ace7-03ff3b45136c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:33.051167 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 288/572] 10.222.0.49 () {56 vars in 1139 bytes} [Thu Jul 14 11:48:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:33.051262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbe340-126d-4812-ace7-03ff3b45136c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:33.051262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbe340-126d-4812-ace7-03ff3b45136c None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:33.052101 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce1a85-bea3-4d5c-b8ec-d7aa6880990c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:33.052274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbe340-126d-4812-ace7-03ff3b45136c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:33.052274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbe340-126d-4812-ace7-03ff3b45136c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:33.052274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbe340-126d-4812-ace7-03ff3b45136c None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:33.066284 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 285/573] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:33.068010 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbe340-126d-4812-ace7-03ff3b45136c None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:33.129176 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:33.163497 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce1a85-bea3-4d5c-b8ec-d7aa6880990c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:33.185687 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbe340-126d-4812-ace7-03ff3b45136c None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:33.204633 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b784f-b5a0-4307-9dc6-6d7031b11d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:33.205301 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b784f-b5a0-4307-9dc6-6d7031b11d4b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:33.205588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b784f-b5a0-4307-9dc6-6d7031b11d4b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:33.205869 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b784f-b5a0-4307-9dc6-6d7031b11d4b None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:33.206662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b784f-b5a0-4307-9dc6-6d7031b11d4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:33.206982 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b784f-b5a0-4307-9dc6-6d7031b11d4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:33.208745 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b784f-b5a0-4307-9dc6-6d7031b11d4b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:33.226400 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 289/574] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:48:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:33.226400 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b784f-b5a0-4307-9dc6-6d7031b11d4b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:33.236420 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a364a47-b0cf-407f-a355-df47140bd77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:33.237329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a364a47-b0cf-407f-a355-df47140bd77f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:33.237684 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a364a47-b0cf-407f-a355-df47140bd77f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:33.238035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a364a47-b0cf-407f-a355-df47140bd77f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:33.241942 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:33.250592 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a364a47-b0cf-407f-a355-df47140bd77f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:33.252078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a364a47-b0cf-407f-a355-df47140bd77f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:33.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-9a364a47-b0cf-407f-a355-df47140bd77f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:33.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:33.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:33.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:33.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:33.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:33.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:33.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:33.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:33.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:33.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:33.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:33.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:33.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:33.269926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:33.270903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:33.271749 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:33.271749 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:33.271749 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:33.271749 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:33.271749 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 286/575] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:33.272695 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a364a47-b0cf-407f-a355-df47140bd77f None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:33.331434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b784f-b5a0-4307-9dc6-6d7031b11d4b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:33.367118 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250d000-d976-4c74-b27e-afbd01c7b55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:33.367944 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250d000-d976-4c74-b27e-afbd01c7b55b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:33.368234 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250d000-d976-4c74-b27e-afbd01c7b55b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:33.368516 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250d000-d976-4c74-b27e-afbd01c7b55b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:33.375399 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250d000-d976-4c74-b27e-afbd01c7b55b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:33.376951 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250d000-d976-4c74-b27e-afbd01c7b55b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:33.385925 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a364a47-b0cf-407f-a355-df47140bd77f None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:33.389210 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:33.392334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-4250d000-d976-4c74-b27e-afbd01c7b55b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:33.392334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:33.392334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:33.392334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:33.392334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:33.392334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:33.392334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:33.392334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:33.392334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:33.392334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:33.392334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:33.392334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:33.392334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:48:33.392334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:48:33.392334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:33.393189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:33.394041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:48:33.394041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:48:33.394041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:48:33.394041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:48:33.394041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:48:33.394041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:48:33.394041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:33.394041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:33.398888 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 290/576] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:33.399584 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250d000-d976-4c74-b27e-afbd01c7b55b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:33.426257 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9838b-639b-41aa-9532-aed5425ac0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:33.427623 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9838b-639b-41aa-9532-aed5425ac0fb None admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:33.428099 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9838b-639b-41aa-9532-aed5425ac0fb None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:33.428388 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9838b-639b-41aa-9532-aed5425ac0fb None admin] PATH_INFO: `/v3/projects/b711bbd57a5446a39ee7c2cf96356083/users/2ac098792b924ce887b3e3abfe596c8d/roles/7ae76d85b6364363960c2e6fc20bc78a` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:33.446049 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9838b-639b-41aa-9532-aed5425ac0fb None admin] RBAC: Authorizing `identity:create_grant(project_id=b711bbd57a5446a39ee7c2cf96356083, user_id=2ac098792b924ce887b3e3abfe596c8d, role_id=7ae76d85b6364363960c2e6fc20bc78a)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:33.447505 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9838b-639b-41aa-9532-aed5425ac0fb None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:33.471933 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 287/577] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:48:33 2022] PUT /identity/v3/projects/b711bbd57a5446a39ee7c2cf96356083/users/2ac098792b924ce887b3e3abfe596c8d/roles/7ae76d85b6364363960c2e6fc20bc78a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:48:33.471933 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9838b-639b-41aa-9532-aed5425ac0fb None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:33.488358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:33.516816 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250d000-d976-4c74-b27e-afbd01c7b55b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:33.558209 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0875b07-ab02-402c-867b-8d0fecb3f9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:33.559727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875b07-ab02-402c-867b-8d0fecb3f9d7 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:33.560144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875b07-ab02-402c-867b-8d0fecb3f9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:33.560620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875b07-ab02-402c-867b-8d0fecb3f9d7 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:33.561974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0875b07-ab02-402c-867b-8d0fecb3f9d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:33.562711 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0875b07-ab02-402c-867b-8d0fecb3f9d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:33.564359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0875b07-ab02-402c-867b-8d0fecb3f9d7 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:33.582158 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 291/578] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:33.587676 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0875b07-ab02-402c-867b-8d0fecb3f9d7 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:33.617933 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9838b-639b-41aa-9532-aed5425ac0fb None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:33.670084 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402d30e-84f5-4c8f-8a06-42a941d98caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:33.671073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402d30e-84f5-4c8f-8a06-42a941d98caa None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:33.671280 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402d30e-84f5-4c8f-8a06-42a941d98caa None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:33.671699 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402d30e-84f5-4c8f-8a06-42a941d98caa None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:33.672851 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402d30e-84f5-4c8f-8a06-42a941d98caa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:33.673499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402d30e-84f5-4c8f-8a06-42a941d98caa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:33.675003 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402d30e-84f5-4c8f-8a06-42a941d98caa None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:33.692575 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 288/579] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:48:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:33.699942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402d30e-84f5-4c8f-8a06-42a941d98caa None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:33.719188 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:33.721406 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0875b07-ab02-402c-867b-8d0fecb3f9d7 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:33.761550 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3147a-0de0-47fb-894b-2b777a98ce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:33.762629 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3147a-0de0-47fb-894b-2b777a98ce94 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:33.763135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3147a-0de0-47fb-894b-2b777a98ce94 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:33.763560 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3147a-0de0-47fb-894b-2b777a98ce94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:33.766920 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:33.774283 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3147a-0de0-47fb-894b-2b777a98ce94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:33.776046 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3147a-0de0-47fb-894b-2b777a98ce94 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:33.791991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-7ff3147a-0de0-47fb-894b-2b777a98ce94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:33.791991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:33.791991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:33.791991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:33.791991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:33.791991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:33.791991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:33.791991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:33.791991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:33.791991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:33.791991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:33.791991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:33.791991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:48:33.791991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:48:33.791991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:33.793097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:33.794209 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:48:33.794209 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:48:33.794209 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:48:33.794209 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:48:33.794209 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:48:33.794209 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:48:33.794209 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:33.794209 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:33.796324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 292/580] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:33.803289 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3147a-0de0-47fb-894b-2b777a98ce94 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:33.828993 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402d30e-84f5-4c8f-8a06-42a941d98caa None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:33.878060 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce10f95-49ec-4937-8d03-6c56f0c91af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:33.881024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce10f95-49ec-4937-8d03-6c56f0c91af0 None admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:33.881467 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce10f95-49ec-4937-8d03-6c56f0c91af0 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:33.881895 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce10f95-49ec-4937-8d03-6c56f0c91af0 None admin] PATH_INFO: `/v3/projects/b711bbd57a5446a39ee7c2cf96356083/users/ab858f5998b348ecbac54423716b7671/roles/7ae76d85b6364363960c2e6fc20bc78a` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:33.904253 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce10f95-49ec-4937-8d03-6c56f0c91af0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b711bbd57a5446a39ee7c2cf96356083, user_id=ab858f5998b348ecbac54423716b7671, role_id=7ae76d85b6364363960c2e6fc20bc78a)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:33.906208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce10f95-49ec-4937-8d03-6c56f0c91af0 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:33.926479 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 289/581] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:48:33 2022] PUT /identity/v3/projects/b711bbd57a5446a39ee7c2cf96356083/users/ab858f5998b348ecbac54423716b7671/roles/7ae76d85b6364363960c2e6fc20bc78a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:48:33.935441 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3147a-0de0-47fb-894b-2b777a98ce94 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:33.982072 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbfaa9-b0d8-414d-ba44-6e8d4b3c8cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:33.983076 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbfaa9-b0d8-414d-ba44-6e8d4b3c8cda None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:33.983513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbfaa9-b0d8-414d-ba44-6e8d4b3c8cda None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:33.983966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbfaa9-b0d8-414d-ba44-6e8d4b3c8cda None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:33.984986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbfaa9-b0d8-414d-ba44-6e8d4b3c8cda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:33.985460 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbfaa9-b0d8-414d-ba44-6e8d4b3c8cda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:33.987192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbfaa9-b0d8-414d-ba44-6e8d4b3c8cda None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:34.002312 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 293/582] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:48:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:34.008692 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce10f95-49ec-4937-8d03-6c56f0c91af0 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:34.085826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:34.129719 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce10f95-49ec-4937-8d03-6c56f0c91af0 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:34.166096 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5da9a-cf56-4db7-89bc-a3a36169e733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:34.167262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5da9a-cf56-4db7-89bc-a3a36169e733 None admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:34.167702 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5da9a-cf56-4db7-89bc-a3a36169e733 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:34.168164 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5da9a-cf56-4db7-89bc-a3a36169e733 None admin] PATH_INFO: `/v3/projects/b711bbd57a5446a39ee7c2cf96356083/users/336c852c9dfb4c6a8ee62134c2ff32ef/roles/7ae76d85b6364363960c2e6fc20bc78a` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:34.185503 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5da9a-cf56-4db7-89bc-a3a36169e733 None admin] RBAC: Authorizing `identity:create_grant(project_id=b711bbd57a5446a39ee7c2cf96356083, user_id=336c852c9dfb4c6a8ee62134c2ff32ef, role_id=7ae76d85b6364363960c2e6fc20bc78a)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:34.187685 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5da9a-cf56-4db7-89bc-a3a36169e733 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:34.202377 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 290/583] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:48:34 2022] PUT /identity/v3/projects/b711bbd57a5446a39ee7c2cf96356083/users/336c852c9dfb4c6a8ee62134c2ff32ef/roles/7ae76d85b6364363960c2e6fc20bc78a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:48:35.200928 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554f032-e98b-4fcd-b07d-fc68736ab71b None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:35.201432 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554f032-e98b-4fcd-b07d-fc68736ab71b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:35.201535 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554f032-e98b-4fcd-b07d-fc68736ab71b None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:35.203082 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 294/584] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:35.208489 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54f5cc-207d-4a55-b04b-a6c6aa8fe414 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:35.208876 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54f5cc-207d-4a55-b04b-a6c6aa8fe414 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:35.209062 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54f5cc-207d-4a55-b04b-a6c6aa8fe414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:35.227504 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-0a54f5cc-207d-4a55-b04b-a6c6aa8fe414 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:35.229422 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-0a54f5cc-207d-4a55-b04b-a6c6aa8fe414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:35.302001 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 291/585] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:35.328156 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554f032-e98b-4fcd-b07d-fc68736ab71b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:35.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:35.448567 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554f032-e98b-4fcd-b07d-fc68736ab71b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:35.484877 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da26967-c6f3-4b80-bfd0-30ec25c1734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:35.485675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da26967-c6f3-4b80-bfd0-30ec25c1734c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:35.485959 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da26967-c6f3-4b80-bfd0-30ec25c1734c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:35.486231 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da26967-c6f3-4b80-bfd0-30ec25c1734c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:35.497013 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da26967-c6f3-4b80-bfd0-30ec25c1734c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-8da26967-c6f3-4b80-bfd0-30ec25c1734c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:35.504938 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:35.505833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:35.507188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:35.507188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:35.507188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:35.507188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:35.507188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:35.507188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:35.507188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:35.507188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:35.507188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:35.507188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:35.507188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:35.507188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:35.507188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 295/586] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:48:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:35.512776 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54f5cc-207d-4a55-b04b-a6c6aa8fe414 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:35.568424 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:35.620548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54f5cc-207d-4a55-b04b-a6c6aa8fe414 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:35.663726 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f0e1a-4c51-467f-a086-fd7ed1cc2f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:35.665379 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0e1a-4c51-467f-a086-fd7ed1cc2f24 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:35.665905 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0e1a-4c51-467f-a086-fd7ed1cc2f24 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:35.666384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0e1a-4c51-467f-a086-fd7ed1cc2f24 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:35.667353 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f0e1a-4c51-467f-a086-fd7ed1cc2f24 None admin] RBAC: Adding query filter params (name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:35.667866 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f0e1a-4c51-467f-a086-fd7ed1cc2f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:35.669477 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f0e1a-4c51-467f-a086-fd7ed1cc2f24 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:35.683335 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 292/587] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 14 11:48:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:35.689077 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da26967-c6f3-4b80-bfd0-30ec25c1734c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:35.798524 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da26967-c6f3-4b80-bfd0-30ec25c1734c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:35.815852 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:35.836287 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098bfc5-0ab8-47a4-b3f4-0af238dbef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:35.837195 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098bfc5-0ab8-47a4-b3f4-0af238dbef01 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:35.837484 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098bfc5-0ab8-47a4-b3f4-0af238dbef01 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:35.837767 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098bfc5-0ab8-47a4-b3f4-0af238dbef01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:35.848896 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098bfc5-0ab8-47a4-b3f4-0af238dbef01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:35.850382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098bfc5-0ab8-47a4-b3f4-0af238dbef01 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:35.869605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-4098bfc5-0ab8-47a4-b3f4-0af238dbef01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:35.869605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:35.869605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:35.869605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:35.869605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:35.869605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:35.869605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:35.869605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:35.869605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:35.869605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:35.869605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:35.869605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:35.869605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:35.869605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:35.869605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:35.870563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:35.871426 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:35.871426 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:35.871426 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:35.871426 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:35.871426 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 296/588] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:35.876714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f0e1a-4c51-467f-a086-fd7ed1cc2f24 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:35.881331 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e7f05-6a93-4135-89a4-e33e6587f79f None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:35.881628 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e7f05-6a93-4135-89a4-e33e6587f79f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:35.881975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e7f05-6a93-4135-89a4-e33e6587f79f None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:35.884146 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 297/589] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:48:35.889056 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad894e8-68a3-43c3-a566-cdba6ed0010e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:35.889345 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad894e8-68a3-43c3-a566-cdba6ed0010e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:35.889627 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad894e8-68a3-43c3-a566-cdba6ed0010e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:35.907980 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-6ad894e8-68a3-43c3-a566-cdba6ed0010e None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:35.909063 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6ad894e8-68a3-43c3-a566-cdba6ed0010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:35.992187 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 298/590] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:48:36.001475 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f0e1a-4c51-467f-a086-fd7ed1cc2f24 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:36.008860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad894e8-68a3-43c3-a566-cdba6ed0010e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:36.009940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:36.042212 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c86dad-6b81-4bbd-b89a-c7e76644820b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:36.043224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c86dad-6b81-4bbd-b89a-c7e76644820b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:36.043402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c86dad-6b81-4bbd-b89a-c7e76644820b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:36.043776 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c86dad-6b81-4bbd-b89a-c7e76644820b None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:36.044615 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c86dad-6b81-4bbd-b89a-c7e76644820b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:36.045025 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c86dad-6b81-4bbd-b89a-c7e76644820b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:36.046486 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c86dad-6b81-4bbd-b89a-c7e76644820b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:36.060674 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 293/591] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:36.065737 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c86dad-6b81-4bbd-b89a-c7e76644820b None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:36.125404 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:36.130291 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad894e8-68a3-43c3-a566-cdba6ed0010e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:36.183019 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d9a4b-ea37-4577-b87a-0eaa3fd19709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:36.184447 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d9a4b-ea37-4577-b87a-0eaa3fd19709 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:36.185378 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d9a4b-ea37-4577-b87a-0eaa3fd19709 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:36.185824 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d9a4b-ea37-4577-b87a-0eaa3fd19709 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:36.189412 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c86dad-6b81-4bbd-b89a-c7e76644820b None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:36.206615 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d9a4b-ea37-4577-b87a-0eaa3fd19709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-2d9d9a4b-ea37-4577-b87a-0eaa3fd19709 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:36.215255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:36.216300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:36.217193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:36.217193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:36.217193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:36.217193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:36.217193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:36.217193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:36.217193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:36.217193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:36.217193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:36.217193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:36.217193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:36.217193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:36.220412 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 299/592] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:48:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:36.223097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d9a4b-ea37-4577-b87a-0eaa3fd19709 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:36.246788 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e70f4e-5491-49aa-9119-97e08923fa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:36.247586 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e70f4e-5491-49aa-9119-97e08923fa07 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:36.247873 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e70f4e-5491-49aa-9119-97e08923fa07 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:36.248175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e70f4e-5491-49aa-9119-97e08923fa07 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:36.259712 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e70f4e-5491-49aa-9119-97e08923fa07 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:36.261241 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e70f4e-5491-49aa-9119-97e08923fa07 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-55e70f4e-5491-49aa-9119-97e08923fa07 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:48:36.277286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:36.278248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:36.279143 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:36.279143 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:36.279143 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:48:36.279143 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:48:36.279143 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:48:36.279143 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:48:36.279143 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:48:36.279143 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:48:36.279143 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:48:36.279143 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:36.283444 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 294/593] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Jul 14 11:48:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:36.284364 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e70f4e-5491-49aa-9119-97e08923fa07 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:36.315620 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:36.359967 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d9a4b-ea37-4577-b87a-0eaa3fd19709 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:36.398276 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e70f4e-5491-49aa-9119-97e08923fa07 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:36.404157 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca40ab0-4b27-4ca8-9fd4-7af7805e689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:36.405088 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca40ab0-4b27-4ca8-9fd4-7af7805e689c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:36.405573 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca40ab0-4b27-4ca8-9fd4-7af7805e689c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:36.406544 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca40ab0-4b27-4ca8-9fd4-7af7805e689c None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:36.407517 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca40ab0-4b27-4ca8-9fd4-7af7805e689c None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:36.408513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca40ab0-4b27-4ca8-9fd4-7af7805e689c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:36.410635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca40ab0-4b27-4ca8-9fd4-7af7805e689c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:36.421016 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 300/594] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 14 11:48:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:36.422321 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c62cf-5cd9-4205-a795-b0b5ff2b64e7 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:36.422619 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c62cf-5cd9-4205-a795-b0b5ff2b64e7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:36.422905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c62cf-5cd9-4205-a795-b0b5ff2b64e7 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:36.424385 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 301/595] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:36.428907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c62cf-5cd9-4205-a795-b0b5ff2b64e7 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:36.440338 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5c028-caaf-4ee3-a3b0-1b824901728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:36.441020 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5c028-caaf-4ee3-a3b0-1b824901728b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:36.441305 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5c028-caaf-4ee3-a3b0-1b824901728b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:36.441589 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5c028-caaf-4ee3-a3b0-1b824901728b None admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:36.442428 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5c028-caaf-4ee3-a3b0-1b824901728b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:36.442741 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5c028-caaf-4ee3-a3b0-1b824901728b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:36.444209 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5c028-caaf-4ee3-a3b0-1b824901728b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:36.458349 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:36.467009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 295/596] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Jul 14 11:48:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:36.467009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9a979-4dcf-4cd7-853d-869f17cc7b3b None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:36.467009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9a979-4dcf-4cd7-853d-869f17cc7b3b None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:36.467009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9a979-4dcf-4cd7-853d-869f17cc7b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:36.490331 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-a2a9a979-4dcf-4cd7-853d-869f17cc7b3b None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:36.491556 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-a2a9a979-4dcf-4cd7-853d-869f17cc7b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:36.551439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c62cf-5cd9-4205-a795-b0b5ff2b64e7 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:36.563975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 296/597] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:36.563975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9a979-4dcf-4cd7-853d-869f17cc7b3b None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:36.589210 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:36.593599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142ed01-f5a4-4ee5-9551-ff33349dec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:36.594426 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142ed01-f5a4-4ee5-9551-ff33349dec53 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:36.594704 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142ed01-f5a4-4ee5-9551-ff33349dec53 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:36.594974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142ed01-f5a4-4ee5-9551-ff33349dec53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:36.605579 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142ed01-f5a4-4ee5-9551-ff33349dec53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:36.607022 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142ed01-f5a4-4ee5-9551-ff33349dec53 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:36.625491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-0142ed01-f5a4-4ee5-9551-ff33349dec53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:36.625491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:36.625491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:36.625491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:36.625491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:36.625491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:36.625491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:36.625491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:36.625491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:36.625491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:36.625491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:36.625491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:36.625491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:36.625491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:36.625491 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:36.626545 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:36.627424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:36.627424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:36.627424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:36.627424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:36.627424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 302/598] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:36.627700 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142ed01-f5a4-4ee5-9551-ff33349dec53 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:36.683436 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9a979-4dcf-4cd7-853d-869f17cc7b3b None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:36.696403 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:36.718114 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32c5f8-eff4-4a8c-9227-8d1d29fb8238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:36.718816 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32c5f8-eff4-4a8c-9227-8d1d29fb8238 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:36.719098 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32c5f8-eff4-4a8c-9227-8d1d29fb8238 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:36.719402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32c5f8-eff4-4a8c-9227-8d1d29fb8238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:36.725714 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142ed01-f5a4-4ee5-9551-ff33349dec53 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:36.761795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2cca1-1ab7-45d2-8c6d-339337c406a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:36.762589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2cca1-1ab7-45d2-8c6d-339337c406a6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:36.763292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2cca1-1ab7-45d2-8c6d-339337c406a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:36.763583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2cca1-1ab7-45d2-8c6d-339337c406a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:36.774446 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2cca1-1ab7-45d2-8c6d-339337c406a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-d1e2cca1-1ab7-45d2-8c6d-339337c406a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:36.782200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:36.783105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:36.784184 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:36.784184 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:36.784184 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:36.784184 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:36.784184 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:36.784184 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:36.784184 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:36.784184 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:36.784184 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:36.784184 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:36.784184 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:36.784184 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:36.784184 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 303/599] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:48:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:36.785093 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ca827-7e66-463d-9413-00e30d8880f7 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:36.785093 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ca827-7e66-463d-9413-00e30d8880f7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:36.785250 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ca827-7e66-463d-9413-00e30d8880f7 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:36.786504 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 304/600] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:36.790739 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ca827-7e66-463d-9413-00e30d8880f7 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:36.796882 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32c5f8-eff4-4a8c-9227-8d1d29fb8238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:36.798593 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32c5f8-eff4-4a8c-9227-8d1d29fb8238 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:36.815073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:36.890071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ca827-7e66-463d-9413-00e30d8880f7 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:36.901564 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 297/601] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:36.902319 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32c5f8-eff4-4a8c-9227-8d1d29fb8238 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:36.924458 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:36.930549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2101e5-2a84-4c85-a8d3-05e6fd9b6988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:36.931215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2101e5-2a84-4c85-a8d3-05e6fd9b6988 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:36.931507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2101e5-2a84-4c85-a8d3-05e6fd9b6988 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:36.931792 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2101e5-2a84-4c85-a8d3-05e6fd9b6988 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:36.932548 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2101e5-2a84-4c85-a8d3-05e6fd9b6988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:36.932864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2101e5-2a84-4c85-a8d3-05e6fd9b6988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:36.934245 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2101e5-2a84-4c85-a8d3-05e6fd9b6988 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:36.946238 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 305/602] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:36.947475 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28663-06bd-43bb-8f0f-862e8a339213 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:36.947770 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28663-06bd-43bb-8f0f-862e8a339213 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:36.948087 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28663-06bd-43bb-8f0f-862e8a339213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:36.964972 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-fec28663-06bd-43bb-8f0f-862e8a339213 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:36.966185 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-fec28663-06bd-43bb-8f0f-862e8a339213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:37.013569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32c5f8-eff4-4a8c-9227-8d1d29fb8238 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:37.029307 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:37.035527 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 306/603] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:37.036837 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec28663-06bd-43bb-8f0f-862e8a339213 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:37.050386 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d393f-b668-4534-9e2d-33a4cb1aed3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:37.051093 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d393f-b668-4534-9e2d-33a4cb1aed3f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:37.051387 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d393f-b668-4534-9e2d-33a4cb1aed3f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:37.051762 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d393f-b668-4534-9e2d-33a4cb1aed3f None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:37.052465 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d393f-b668-4534-9e2d-33a4cb1aed3f None admin] RBAC: Adding query filter params (name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:37.052779 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d393f-b668-4534-9e2d-33a4cb1aed3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:37.054161 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d393f-b668-4534-9e2d-33a4cb1aed3f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:37.063661 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 298/604] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 14 11:48:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:37.064519 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d393f-b668-4534-9e2d-33a4cb1aed3f None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:37.140202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec28663-06bd-43bb-8f0f-862e8a339213 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:37.162698 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:37.167812 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d393f-b668-4534-9e2d-33a4cb1aed3f None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:37.174613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c9381-2378-440a-a52c-2c8c389cc224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:37.175414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c9381-2378-440a-a52c-2c8c389cc224 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:37.175697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c9381-2378-440a-a52c-2c8c389cc224 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:37.176003 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c9381-2378-440a-a52c-2c8c389cc224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:37.186814 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c9381-2378-440a-a52c-2c8c389cc224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:37.188323 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c9381-2378-440a-a52c-2c8c389cc224 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:37.202955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9046c5-aab3-4004-a060-553faf17bd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:37.203744 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9046c5-aab3-4004-a060-553faf17bd9e None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:37.204060 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9046c5-aab3-4004-a060-553faf17bd9e None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:37.204336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9046c5-aab3-4004-a060-553faf17bd9e None admin] PATH_INFO: `/v3/users/glance` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:37.206165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-e28c9381-2378-440a-a52c-2c8c389cc224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:37.206165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:37.206165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:37.206165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:37.206165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:37.206165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:37.206165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:37.206165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:37.206165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:37.206165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:37.206165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:37.206165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:37.206165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:37.206165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:37.206165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:37.207564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:37.208467 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:37.208467 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:37.208467 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:37.208467 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:37.208467 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 307/605] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:37.208467 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c9381-2378-440a-a52c-2c8c389cc224 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:37.214896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9046c5-aab3-4004-a060-553faf17bd9e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:37.216384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9046c5-aab3-4004-a060-553faf17bd9e None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-ee9046c5-aab3-4004-a060-553faf17bd9e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:48:37.230557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:37.231580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:37.232545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:37.232545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:37.232545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:48:37.232545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:48:37.232545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:48:37.232545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:48:37.232545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:48:37.232545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:48:37.232545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:48:37.232545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:37.232545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 299/606] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:37.233111 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9046c5-aab3-4004-a060-553faf17bd9e None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:37.269001 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:37.321310 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c9381-2378-440a-a52c-2c8c389cc224 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:37.335564 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9046c5-aab3-4004-a060-553faf17bd9e None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:37.361761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6641169-5993-4bf0-bf33-2798b69365fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:37.362670 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6641169-5993-4bf0-bf33-2798b69365fd None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:37.362956 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6641169-5993-4bf0-bf33-2798b69365fd None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:37.363232 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6641169-5993-4bf0-bf33-2798b69365fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:37.371123 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d90f0d-57d6-4da2-bf7f-b63e10b739ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:37.371929 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d90f0d-57d6-4da2-bf7f-b63e10b739ac None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:37.372213 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d90f0d-57d6-4da2-bf7f-b63e10b739ac None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:37.372488 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d90f0d-57d6-4da2-bf7f-b63e10b739ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:37.373521 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6641169-5993-4bf0-bf33-2798b69365fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-d6641169-5993-4bf0-bf33-2798b69365fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:37.381293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:37.382202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:37.383041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:37.383041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:37.383041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:37.383041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:37.383041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:37.383041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:37.383041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:37.383041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:37.383041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:37.383041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:37.383041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:48:37.383041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:37.383041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 308/607] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:48:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:37.383756 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6641169-5993-4bf0-bf33-2798b69365fd None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:37.389829 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d90f0d-57d6-4da2-bf7f-b63e10b739ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:37.391506 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d90f0d-57d6-4da2-bf7f-b63e10b739ac None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:37.409723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-43d90f0d-57d6-4da2-bf7f-b63e10b739ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:37.409723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:37.409723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:37.409723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:37.409723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:37.409723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:37.409723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:37.409723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:37.409723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:37.409723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:37.409723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:37.409723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:37.409723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:37.409723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:37.409723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:37.410696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:37.411561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:37.411561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:37.411561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:37.411561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:37.411561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 300/608] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:37.411848 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d90f0d-57d6-4da2-bf7f-b63e10b739ac None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:37.423822 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:37.488193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6641169-5993-4bf0-bf33-2798b69365fd None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:37.500147 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:37.512654 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d90f0d-57d6-4da2-bf7f-b63e10b739ac None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:37.521608 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365a6da-a69b-4768-ada5-f34d4e500f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:37.522271 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365a6da-a69b-4768-ada5-f34d4e500f32 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:37.522565 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365a6da-a69b-4768-ada5-f34d4e500f32 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:37.522841 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365a6da-a69b-4768-ada5-f34d4e500f32 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:37.523556 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365a6da-a69b-4768-ada5-f34d4e500f32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:37.524438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365a6da-a69b-4768-ada5-f34d4e500f32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:37.525872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365a6da-a69b-4768-ada5-f34d4e500f32 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:37.539274 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 309/609] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:37.540816 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365a6da-a69b-4768-ada5-f34d4e500f32 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:37.551814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561711a6-9c0e-483a-ab1b-db05834cde4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:37.552529 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561711a6-9c0e-483a-ab1b-db05834cde4e None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:37.552815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561711a6-9c0e-483a-ab1b-db05834cde4e None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:37.553094 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561711a6-9c0e-483a-ab1b-db05834cde4e None admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:37.553930 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561711a6-9c0e-483a-ab1b-db05834cde4e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:37.554244 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561711a6-9c0e-483a-ab1b-db05834cde4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:37.556372 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561711a6-9c0e-483a-ab1b-db05834cde4e None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:37.574219 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 301/610] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Jul 14 11:48:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:37.575023 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561711a6-9c0e-483a-ab1b-db05834cde4e None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:37.634421 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:37.641256 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365a6da-a69b-4768-ada5-f34d4e500f32 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:37.682732 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af0c27-a92e-4670-a6ed-e2c2ff4a2f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:37.683924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561711a6-9c0e-483a-ab1b-db05834cde4e None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:37.684679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af0c27-a92e-4670-a6ed-e2c2ff4a2f97 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:37.684966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af0c27-a92e-4670-a6ed-e2c2ff4a2f97 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:37.685246 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af0c27-a92e-4670-a6ed-e2c2ff4a2f97 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:37.686027 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af0c27-a92e-4670-a6ed-e2c2ff4a2f97 None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:37.686588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af0c27-a92e-4670-a6ed-e2c2ff4a2f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:37.687996 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af0c27-a92e-4670-a6ed-e2c2ff4a2f97 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:37.696931 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 310/611] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 14 11:48:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:37.697733 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af0c27-a92e-4670-a6ed-e2c2ff4a2f97 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:37.726881 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb389235-026c-45ac-8b22-fbde68d17cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:37.728241 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb389235-026c-45ac-8b22-fbde68d17cd7 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:37.728560 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb389235-026c-45ac-8b22-fbde68d17cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:37.728965 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb389235-026c-45ac-8b22-fbde68d17cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:37.729680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb389235-026c-45ac-8b22-fbde68d17cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:37.729992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb389235-026c-45ac-8b22-fbde68d17cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:37.731359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb389235-026c-45ac-8b22-fbde68d17cd7 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:37.743760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 302/612] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:37.744880 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb389235-026c-45ac-8b22-fbde68d17cd7 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:37.754921 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:37.798164 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af0c27-a92e-4670-a6ed-e2c2ff4a2f97 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:37.831838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fdffe-c8ed-49aa-beed-6b1d8d978621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:37.832713 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fdffe-c8ed-49aa-beed-6b1d8d978621 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:37.832998 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fdffe-c8ed-49aa-beed-6b1d8d978621 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:37.833273 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fdffe-c8ed-49aa-beed-6b1d8d978621 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:37.839846 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fdffe-c8ed-49aa-beed-6b1d8d978621 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:37.841345 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fdffe-c8ed-49aa-beed-6b1d8d978621 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:37.846348 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb389235-026c-45ac-8b22-fbde68d17cd7 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:37.855708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-d93fdffe-c8ed-49aa-beed-6b1d8d978621 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:37.855708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:37.855708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:37.855708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:37.855708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:37.855708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:37.855708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:37.855708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:37.855708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:37.855708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:37.855708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:37.855708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:37.855708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:48:37.855708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:48:37.855708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:37.856637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:37.857477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:48:37.857477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:48:37.857477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:48:37.857477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:48:37.857477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:48:37.857477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:48:37.857477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:37.857477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:37.857477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 311/613] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:37.857943 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fdffe-c8ed-49aa-beed-6b1d8d978621 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:37.880157 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:37.883802 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97b519-e112-43f4-affb-52993fa775dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:37.884720 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97b519-e112-43f4-affb-52993fa775dc None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:37.885165 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97b519-e112-43f4-affb-52993fa775dc None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:37.885448 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97b519-e112-43f4-affb-52993fa775dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:37.952773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97b519-e112-43f4-affb-52993fa775dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:37.954140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97b519-e112-43f4-affb-52993fa775dc None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:37.962481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fdffe-c8ed-49aa-beed-6b1d8d978621 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:37.962841 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:37.998189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e31a7-4fa4-438f-8ede-6166392ae299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:37.998978 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e31a7-4fa4-438f-8ede-6166392ae299 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:37.999264 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e31a7-4fa4-438f-8ede-6166392ae299 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:37.999541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e31a7-4fa4-438f-8ede-6166392ae299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:38.013899 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e31a7-4fa4-438f-8ede-6166392ae299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:38.015485 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e31a7-4fa4-438f-8ede-6166392ae299 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:38.034139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-743e31a7-4fa4-438f-8ede-6166392ae299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:38.034139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:38.034139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:38.034139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:38.034139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:38.034139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:38.034139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:38.034139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:38.034139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:38.034139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:38.034139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:38.034139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:38.034139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:38.034139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:38.034139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:38.035057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:38.035953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:38.035953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:38.035953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:38.035953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:38.035953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 312/614] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:38.036235 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e31a7-4fa4-438f-8ede-6166392ae299 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:38.065011 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 303/615] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:38.065851 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97b519-e112-43f4-affb-52993fa775dc None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:38.101878 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:38.135016 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e31a7-4fa4-438f-8ede-6166392ae299 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:38.167249 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97b519-e112-43f4-affb-52993fa775dc None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:38.169705 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909c8e7-ce6c-4996-a607-b80983ee0cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:38.170495 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909c8e7-ce6c-4996-a607-b80983ee0cbc None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:38.170780 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909c8e7-ce6c-4996-a607-b80983ee0cbc None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:38.171052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909c8e7-ce6c-4996-a607-b80983ee0cbc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:38.175391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:38.181071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909c8e7-ce6c-4996-a607-b80983ee0cbc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:38.182573 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909c8e7-ce6c-4996-a607-b80983ee0cbc None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-2909c8e7-ce6c-4996-a607-b80983ee0cbc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:48:38.197414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:38.198437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:38.199351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:38.199351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:38.199351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:48:38.199351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:48:38.199351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:48:38.199351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:48:38.199351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:48:38.199351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:48:38.199351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:48:38.199351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:38.199351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 313/616] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:38.199351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909c8e7-ce6c-4996-a607-b80983ee0cbc None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:38.207858 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e3e19-f2ba-469b-8f30-2ec535cf29a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:38.208494 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e3e19-f2ba-469b-8f30-2ec535cf29a4 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:38.208776 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e3e19-f2ba-469b-8f30-2ec535cf29a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:38.209052 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e3e19-f2ba-469b-8f30-2ec535cf29a4 None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:38.209832 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e3e19-f2ba-469b-8f30-2ec535cf29a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:38.210139 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e3e19-f2ba-469b-8f30-2ec535cf29a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:38.211558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e3e19-f2ba-469b-8f30-2ec535cf29a4 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:38.228803 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 304/617] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:48:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:38.228803 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e3e19-f2ba-469b-8f30-2ec535cf29a4 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:38.297524 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909c8e7-ce6c-4996-a607-b80983ee0cbc None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:38.323567 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:38.325616 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e3e19-f2ba-469b-8f30-2ec535cf29a4 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:38.332448 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344923bc-1f98-472c-9922-2d5834410232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:38.333107 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344923bc-1f98-472c-9922-2d5834410232 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:38.333392 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344923bc-1f98-472c-9922-2d5834410232 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:38.333670 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344923bc-1f98-472c-9922-2d5834410232 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:38.334391 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344923bc-1f98-472c-9922-2d5834410232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:38.334700 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344923bc-1f98-472c-9922-2d5834410232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:38.336096 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344923bc-1f98-472c-9922-2d5834410232 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:38.347942 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 314/618] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:38.348584 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344923bc-1f98-472c-9922-2d5834410232 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:38.365383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414ad82-349f-41a3-bb41-7818c25f928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:38.366175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414ad82-349f-41a3-bb41-7818c25f928f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:38.366464 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414ad82-349f-41a3-bb41-7818c25f928f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:38.366741 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414ad82-349f-41a3-bb41-7818c25f928f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:38.377374 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414ad82-349f-41a3-bb41-7818c25f928f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:38.378814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414ad82-349f-41a3-bb41-7818c25f928f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:38.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-8414ad82-349f-41a3-bb41-7818c25f928f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:38.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:38.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:38.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:38.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:38.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:38.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:38.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:38.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:38.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:38.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:38.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:38.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:38.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:38.395581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:38.396557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:38.397419 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:38.397419 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:38.397419 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:38.397419 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:38.400034 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 305/619] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:38.401294 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414ad82-349f-41a3-bb41-7818c25f928f None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:38.420571 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:38.445544 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344923bc-1f98-472c-9922-2d5834410232 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:38.478817 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b6b94-b4d6-4045-99d6-95570542808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:38.479401 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b6b94-b4d6-4045-99d6-95570542808d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:38.479687 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b6b94-b4d6-4045-99d6-95570542808d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:38.479991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b6b94-b4d6-4045-99d6-95570542808d None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:38.480815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b6b94-b4d6-4045-99d6-95570542808d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:38.481123 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b6b94-b4d6-4045-99d6-95570542808d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:38.482549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b6b94-b4d6-4045-99d6-95570542808d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:38.499024 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 315/620] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Jul 14 11:48:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:38.499825 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b6b94-b4d6-4045-99d6-95570542808d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:38.502526 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414ad82-349f-41a3-bb41-7818c25f928f None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:38.537520 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a38c73-30e1-45eb-afb4-62c4a50dcecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:38.538174 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a38c73-30e1-45eb-afb4-62c4a50dcecb None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:38.538461 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a38c73-30e1-45eb-afb4-62c4a50dcecb None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:38.538740 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a38c73-30e1-45eb-afb4-62c4a50dcecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:38.539591 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a38c73-30e1-45eb-afb4-62c4a50dcecb None admin] RBAC: Adding query filter params (role.id=7ae76d85b6364363960c2e6fc20bc78a, scope.project.id=b711bbd57a5446a39ee7c2cf96356083, user.id=6fd8e197398e465aa3247d2ea89430d8) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:38.539916 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a38c73-30e1-45eb-afb4-62c4a50dcecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:38.541458 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a38c73-30e1-45eb-afb4-62c4a50dcecb None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:38.545713 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:38.548014 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 306/621] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:48:38 2022] GET /identity/v3/role_assignments?user.id=6fd8e197398e465aa3247d2ea89430d8&scope.project.id=b711bbd57a5446a39ee7c2cf96356083&role.id=7ae76d85b6364363960c2e6fc20bc78a => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:38.549422 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a38c73-30e1-45eb-afb4-62c4a50dcecb None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:38.612049 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b6b94-b4d6-4045-99d6-95570542808d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:38.644205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:38.652436 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4926b-2aeb-4293-92ed-b1b5b43a21b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:38.653264 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4926b-2aeb-4293-92ed-b1b5b43a21b6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:38.653551 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4926b-2aeb-4293-92ed-b1b5b43a21b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:38.653828 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4926b-2aeb-4293-92ed-b1b5b43a21b6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:38.662420 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4926b-2aeb-4293-92ed-b1b5b43a21b6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:38.663946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4926b-2aeb-4293-92ed-b1b5b43a21b6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:38.666674 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a38c73-30e1-45eb-afb4-62c4a50dcecb None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-b6e4926b-2aeb-4293-92ed-b1b5b43a21b6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:48:38.680144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:38.681375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:38.682424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:38.682424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:38.682424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:48:38.682424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:48:38.682424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:48:38.682424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:48:38.682424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:48:38.682424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:48:38.682424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:48:38.682424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:38.682424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 316/622] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:48:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:38.682424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4926b-2aeb-4293-92ed-b1b5b43a21b6 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:38.708786 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3866f6a-54ce-40d6-80e4-ed6248f36a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:38.709600 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3866f6a-54ce-40d6-80e4-ed6248f36a52 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:38.709955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3866f6a-54ce-40d6-80e4-ed6248f36a52 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:38.710312 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3866f6a-54ce-40d6-80e4-ed6248f36a52 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:38.711115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3866f6a-54ce-40d6-80e4-ed6248f36a52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:38.711494 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3866f6a-54ce-40d6-80e4-ed6248f36a52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:38.713932 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3866f6a-54ce-40d6-80e4-ed6248f36a52 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:38.727316 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 307/623] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:38.732553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3866f6a-54ce-40d6-80e4-ed6248f36a52 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:38.810052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4926b-2aeb-4293-92ed-b1b5b43a21b6 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:38.819713 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:38.847994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3866f6a-54ce-40d6-80e4-ed6248f36a52 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:38.848550 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6e2f0-5ba5-4ef6-a498-9228b741b878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:38.849196 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6e2f0-5ba5-4ef6-a498-9228b741b878 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:38.849478 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6e2f0-5ba5-4ef6-a498-9228b741b878 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:38.849751 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6e2f0-5ba5-4ef6-a498-9228b741b878 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:38.887596 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9fa3b-39e3-4625-bea5-31f4da3e9ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:38.892922 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9fa3b-39e3-4625-bea5-31f4da3e9ae0 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:38.893217 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9fa3b-39e3-4625-bea5-31f4da3e9ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:38.893506 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9fa3b-39e3-4625-bea5-31f4da3e9ae0 None admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:38.894757 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9fa3b-39e3-4625-bea5-31f4da3e9ae0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:38.895056 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9fa3b-39e3-4625-bea5-31f4da3e9ae0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:38.896856 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9fa3b-39e3-4625-bea5-31f4da3e9ae0 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:38.912668 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:38.922078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 308/624] 10.222.0.49 () {56 vars in 1139 bytes} [Thu Jul 14 11:48:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:38.922959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9fa3b-39e3-4625-bea5-31f4da3e9ae0 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:38.923955 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6e2f0-5ba5-4ef6-a498-9228b741b878 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:38.925511 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6e2f0-5ba5-4ef6-a498-9228b741b878 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:39.032076 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 317/625] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:39.033192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6e2f0-5ba5-4ef6-a498-9228b741b878 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:39.041198 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:39.045062 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9fa3b-39e3-4625-bea5-31f4da3e9ae0 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:39.083956 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e282e31-4100-4caf-a05a-a64249a244d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:39.084931 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e282e31-4100-4caf-a05a-a64249a244d0 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:39.085234 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e282e31-4100-4caf-a05a-a64249a244d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:39.085513 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e282e31-4100-4caf-a05a-a64249a244d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:39.093490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e282e31-4100-4caf-a05a-a64249a244d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:39.095074 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e282e31-4100-4caf-a05a-a64249a244d0 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:39.109587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-1e282e31-4100-4caf-a05a-a64249a244d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:39.109587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:39.109587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:39.109587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:39.109587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:39.109587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:39.109587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:39.109587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:39.109587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:39.109587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:39.109587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:39.109587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:39.109587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:48:39.109587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:48:39.109587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:39.110490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:39.111370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:48:39.111370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:48:39.111370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:48:39.111370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:48:39.111370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:48:39.111370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:48:39.111370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:39.111370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:39.115426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 309/626] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:39.116180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e282e31-4100-4caf-a05a-a64249a244d0 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:39.140848 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6e2f0-5ba5-4ef6-a498-9228b741b878 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:39.181656 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:39.185906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace76be-f038-46dd-a72f-410611a34192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:39.189741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace76be-f038-46dd-a72f-410611a34192 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:39.189741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace76be-f038-46dd-a72f-410611a34192 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:39.189741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace76be-f038-46dd-a72f-410611a34192 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:39.226997 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e282e31-4100-4caf-a05a-a64249a244d0 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:39.267282 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095594e2-cc2d-45fb-b3c5-08db5450168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:39.268191 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095594e2-cc2d-45fb-b3c5-08db5450168e None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:39.268481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095594e2-cc2d-45fb-b3c5-08db5450168e None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:39.268761 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095594e2-cc2d-45fb-b3c5-08db5450168e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:39.274370 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace76be-f038-46dd-a72f-410611a34192 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:39.276992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace76be-f038-46dd-a72f-410611a34192 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:39.281353 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095594e2-cc2d-45fb-b3c5-08db5450168e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:39.282900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095594e2-cc2d-45fb-b3c5-08db5450168e None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:39.286019 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:39.302499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-095594e2-cc2d-45fb-b3c5-08db5450168e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:39.302499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:39.302499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:39.302499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:39.302499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:39.302499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:39.302499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:39.302499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:39.302499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:39.302499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:39.302499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:39.302499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:39.302499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:39.302499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:39.302499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:39.303411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:39.304843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:39.304843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:39.304843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:39.304843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:39.304843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 310/627] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:39.304843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095594e2-cc2d-45fb-b3c5-08db5450168e None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:39.393407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 318/628] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:39.394972 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace76be-f038-46dd-a72f-410611a34192 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:39.422263 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095594e2-cc2d-45fb-b3c5-08db5450168e None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:39.437845 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:39.461500 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1e126-c7b7-4079-9a1f-2b2ff911cb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:39.462164 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1e126-c7b7-4079-9a1f-2b2ff911cb65 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:39.462452 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1e126-c7b7-4079-9a1f-2b2ff911cb65 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:39.462761 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1e126-c7b7-4079-9a1f-2b2ff911cb65 None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:39.463548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1e126-c7b7-4079-9a1f-2b2ff911cb65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:39.464001 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1e126-c7b7-4079-9a1f-2b2ff911cb65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:39.465538 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1e126-c7b7-4079-9a1f-2b2ff911cb65 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:39.482979 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 311/629] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:48:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:39.482979 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1e126-c7b7-4079-9a1f-2b2ff911cb65 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:39.505094 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace76be-f038-46dd-a72f-410611a34192 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:39.513011 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:39.545271 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f640e19-b702-462f-a78d-2934a5f57d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:39.545865 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f640e19-b702-462f-a78d-2934a5f57d4a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:39.546153 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f640e19-b702-462f-a78d-2934a5f57d4a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:39.546433 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f640e19-b702-462f-a78d-2934a5f57d4a None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:39.547149 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f640e19-b702-462f-a78d-2934a5f57d4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:39.547462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f640e19-b702-462f-a78d-2934a5f57d4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:39.549601 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f640e19-b702-462f-a78d-2934a5f57d4a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:39.561221 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 319/630] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:39.562024 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f640e19-b702-462f-a78d-2934a5f57d4a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:39.591493 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1e126-c7b7-4079-9a1f-2b2ff911cb65 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:39.631533 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b685d31-5db5-4512-b825-07d72fa795b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:39.632728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b685d31-5db5-4512-b825-07d72fa795b9 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:39.633133 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b685d31-5db5-4512-b825-07d72fa795b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:39.633421 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b685d31-5db5-4512-b825-07d72fa795b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:39.645500 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b685d31-5db5-4512-b825-07d72fa795b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:39.646946 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b685d31-5db5-4512-b825-07d72fa795b9 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:39.665402 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f640e19-b702-462f-a78d-2934a5f57d4a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:39.665951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-8b685d31-5db5-4512-b825-07d72fa795b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:39.665951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:39.665951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:39.665951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:39.665951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:39.665951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:39.665951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:39.665951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:39.665951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:39.665951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:39.665951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:39.665951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:39.665951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:39.665951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:39.665951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:39.666892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:39.667782 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:39.667782 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:39.667782 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:39.667782 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:39.667782 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 312/631] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:39.668091 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b685d31-5db5-4512-b825-07d72fa795b9 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:39.696201 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:39.709081 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a0eb0-83ae-408b-9335-1a7f8e127df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:39.709741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a0eb0-83ae-408b-9335-1a7f8e127df5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:39.710025 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a0eb0-83ae-408b-9335-1a7f8e127df5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:39.710303 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a0eb0-83ae-408b-9335-1a7f8e127df5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:39.711130 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a0eb0-83ae-408b-9335-1a7f8e127df5 None admin] RBAC: Adding query filter params (role.id=7ae76d85b6364363960c2e6fc20bc78a, scope.project.id=b711bbd57a5446a39ee7c2cf96356083, user.id=2ac098792b924ce887b3e3abfe596c8d) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:39.711448 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a0eb0-83ae-408b-9335-1a7f8e127df5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:39.712971 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a0eb0-83ae-408b-9335-1a7f8e127df5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:39.719153 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 320/632] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:48:39 2022] GET /identity/v3/role_assignments?user.id=2ac098792b924ce887b3e3abfe596c8d&scope.project.id=b711bbd57a5446a39ee7c2cf96356083&role.id=7ae76d85b6364363960c2e6fc20bc78a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:39.719980 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a0eb0-83ae-408b-9335-1a7f8e127df5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:39.756153 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:39.808200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b685d31-5db5-4512-b825-07d72fa795b9 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:39.853741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a0eb0-83ae-408b-9335-1a7f8e127df5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:39.855781 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dd336-68f4-4a38-ab3f-b96fd286ea66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:39.856848 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dd336-68f4-4a38-ab3f-b96fd286ea66 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:39.857135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dd336-68f4-4a38-ab3f-b96fd286ea66 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:39.858892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dd336-68f4-4a38-ab3f-b96fd286ea66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:39.868852 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531dd336-68f4-4a38-ab3f-b96fd286ea66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:39.871618 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531dd336-68f4-4a38-ab3f-b96fd286ea66 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:39.891343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-531dd336-68f4-4a38-ab3f-b96fd286ea66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:39.891343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:39.891343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:39.891343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:39.891343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:39.891343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:39.891343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:39.891343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:39.891343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:39.891343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:39.891343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:39.891343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:39.891343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:48:39.891343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:48:39.891343 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:39.892333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:39.893186 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:48:39.893186 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:48:39.893186 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:48:39.893186 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:48:39.893186 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:48:39.893186 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:48:39.893186 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:39.893186 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:39.893592 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3d5b9-e1de-4224-8128-44ae71d79d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:39.894175 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3d5b9-e1de-4224-8128-44ae71d79d5b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:39.894353 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3d5b9-e1de-4224-8128-44ae71d79d5b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:39.894635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3d5b9-e1de-4224-8128-44ae71d79d5b None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:39.895362 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3d5b9-e1de-4224-8128-44ae71d79d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:39.895672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3d5b9-e1de-4224-8128-44ae71d79d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:39.896760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 313/633] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:39.897098 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3d5b9-e1de-4224-8128-44ae71d79d5b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:39.902614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dd336-68f4-4a38-ab3f-b96fd286ea66 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:39.915984 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 321/634] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:39.918358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3d5b9-e1de-4224-8128-44ae71d79d5b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:40.018248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:40.039018 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dd336-68f4-4a38-ab3f-b96fd286ea66 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:40.057284 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3d5b9-e1de-4224-8128-44ae71d79d5b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:40.084669 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c87af-7c91-40c8-8939-1cf23010a75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:40.085258 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c87af-7c91-40c8-8939-1cf23010a75c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:40.085542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c87af-7c91-40c8-8939-1cf23010a75c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:40.085819 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c87af-7c91-40c8-8939-1cf23010a75c None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:40.086600 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c87af-7c91-40c8-8939-1cf23010a75c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:40.087060 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c87af-7c91-40c8-8939-1cf23010a75c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:40.089778 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c87af-7c91-40c8-8939-1cf23010a75c None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:40.100891 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfcb80-5bff-420d-a4b1-b636f196ce71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:40.102932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfcb80-5bff-420d-a4b1-b636f196ce71 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:40.103445 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfcb80-5bff-420d-a4b1-b636f196ce71 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:40.104014 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfcb80-5bff-420d-a4b1-b636f196ce71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:40.105347 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 314/635] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:48:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:40.106784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:40.110971 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c87af-7c91-40c8-8939-1cf23010a75c None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:40.121193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfcb80-5bff-420d-a4b1-b636f196ce71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:40.124044 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfcb80-5bff-420d-a4b1-b636f196ce71 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:40.144906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-3dbfcb80-5bff-420d-a4b1-b636f196ce71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:40.144906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:40.144906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:40.144906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:40.144906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:40.144906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:40.144906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:40.144906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:40.144906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:40.144906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:40.144906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:40.144906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:40.144906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:48:40.144906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:48:40.144906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:40.145803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:40.146694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:48:40.146694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:48:40.146694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:48:40.146694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:48:40.146694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:48:40.146694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:48:40.146694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:40.146694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:40.149873 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 322/636] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:40.157417 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfcb80-5bff-420d-a4b1-b636f196ce71 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:40.245153 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c87af-7c91-40c8-8939-1cf23010a75c None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:40.278330 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfcb80-5bff-420d-a4b1-b636f196ce71 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:40.294347 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc155f7-0ade-47a4-b3b7-745b711eb2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:40.295541 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc155f7-0ade-47a4-b3b7-745b711eb2c7 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:40.296012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc155f7-0ade-47a4-b3b7-745b711eb2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:40.296438 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc155f7-0ade-47a4-b3b7-745b711eb2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:40.298054 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc155f7-0ade-47a4-b3b7-745b711eb2c7 None admin] RBAC: Adding query filter params (role.id=7ae76d85b6364363960c2e6fc20bc78a, scope.project.id=b711bbd57a5446a39ee7c2cf96356083, user.id=ab858f5998b348ecbac54423716b7671) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:40.298526 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc155f7-0ade-47a4-b3b7-745b711eb2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:40.300186 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc155f7-0ade-47a4-b3b7-745b711eb2c7 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:40.309466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 315/637] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:48:40 2022] GET /identity/v3/role_assignments?user.id=ab858f5998b348ecbac54423716b7671&scope.project.id=b711bbd57a5446a39ee7c2cf96356083&role.id=7ae76d85b6364363960c2e6fc20bc78a => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:40.319735 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38105ea7-51be-436b-b517-5a5ba7e47008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:40.320721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38105ea7-51be-436b-b517-5a5ba7e47008 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:40.321161 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38105ea7-51be-436b-b517-5a5ba7e47008 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:40.321623 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38105ea7-51be-436b-b517-5a5ba7e47008 None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:40.322585 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38105ea7-51be-436b-b517-5a5ba7e47008 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:40.323646 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38105ea7-51be-436b-b517-5a5ba7e47008 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:40.325409 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38105ea7-51be-436b-b517-5a5ba7e47008 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:40.340597 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 323/638] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:48:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:40.347542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc155f7-0ade-47a4-b3b7-745b711eb2c7 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:40.359404 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:40.468695 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc155f7-0ade-47a4-b3b7-745b711eb2c7 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:40.508478 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23833651-b470-4252-bf78-598101ea1ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:40.509399 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23833651-b470-4252-bf78-598101ea1ecf None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:40.509851 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23833651-b470-4252-bf78-598101ea1ecf None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:40.510916 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23833651-b470-4252-bf78-598101ea1ecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:40.511886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23833651-b470-4252-bf78-598101ea1ecf None admin] RBAC: Adding query filter params (role.id=7ae76d85b6364363960c2e6fc20bc78a, scope.project.id=b711bbd57a5446a39ee7c2cf96356083, user.id=336c852c9dfb4c6a8ee62134c2ff32ef) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:40.512373 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23833651-b470-4252-bf78-598101ea1ecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:40.513942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23833651-b470-4252-bf78-598101ea1ecf None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:40.520735 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 316/639] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:48:40 2022] GET /identity/v3/role_assignments?user.id=336c852c9dfb4c6a8ee62134c2ff32ef&scope.project.id=b711bbd57a5446a39ee7c2cf96356083&role.id=7ae76d85b6364363960c2e6fc20bc78a => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:40.931425 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31001e-940e-43ad-8878-bc5a1f404eaa None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:40.931964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31001e-940e-43ad-8878-bc5a1f404eaa None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:40.932045 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31001e-940e-43ad-8878-bc5a1f404eaa None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:40.934358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 324/640] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:40.940177 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd3fcd-1391-4c1c-9de2-d41d0e5cf863 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:40.940544 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd3fcd-1391-4c1c-9de2-d41d0e5cf863 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:40.940898 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd3fcd-1391-4c1c-9de2-d41d0e5cf863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:40.958587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-25bd3fcd-1391-4c1c-9de2-d41d0e5cf863 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:40.959772 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-25bd3fcd-1391-4c1c-9de2-d41d0e5cf863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:41.034835 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 317/641] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:41.059908 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31001e-940e-43ad-8878-bc5a1f404eaa None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:41.074681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:41.172946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31001e-940e-43ad-8878-bc5a1f404eaa None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:41.211173 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea913881-c470-4ee6-921a-1936dbbd62ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:41.211904 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea913881-c470-4ee6-921a-1936dbbd62ca None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:41.212190 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea913881-c470-4ee6-921a-1936dbbd62ca None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:41.212467 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea913881-c470-4ee6-921a-1936dbbd62ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:41.223001 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea913881-c470-4ee6-921a-1936dbbd62ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-ea913881-c470-4ee6-921a-1936dbbd62ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:41.230651 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:41.231638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:41.232599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:41.232599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:41.232599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:41.232599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:41.232599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:41.232599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:41.232599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:41.232599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:41.232599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:41.232599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:41.232599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:48:41.232599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:41.236204 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 325/642] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:48:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:41.240980 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd3fcd-1391-4c1c-9de2-d41d0e5cf863 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:41.243228 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:41.350865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd3fcd-1391-4c1c-9de2-d41d0e5cf863 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:41.386852 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd319a2-be98-4f8e-a3a3-a59ca7a82c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:41.387829 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd319a2-be98-4f8e-a3a3-a59ca7a82c95 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:41.388321 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd319a2-be98-4f8e-a3a3-a59ca7a82c95 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:41.388790 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd319a2-be98-4f8e-a3a3-a59ca7a82c95 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:41.389709 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd319a2-be98-4f8e-a3a3-a59ca7a82c95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:41.390213 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd319a2-be98-4f8e-a3a3-a59ca7a82c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:41.391874 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd319a2-be98-4f8e-a3a3-a59ca7a82c95 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:41.401463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 318/643] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:41.407713 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea913881-c470-4ee6-921a-1936dbbd62ca None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:41.487102 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:41.522627 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea913881-c470-4ee6-921a-1936dbbd62ca None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:41.563553 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49990e-78e1-44db-9830-bd1a8f211fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:41.564983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49990e-78e1-44db-9830-bd1a8f211fe5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:41.565464 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49990e-78e1-44db-9830-bd1a8f211fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:41.565918 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49990e-78e1-44db-9830-bd1a8f211fe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:41.579797 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49990e-78e1-44db-9830-bd1a8f211fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:41.581628 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49990e-78e1-44db-9830-bd1a8f211fe5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:41.600755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-5d49990e-78e1-44db-9830-bd1a8f211fe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:41.600755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:41.600755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:41.600755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:41.600755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:41.600755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:41.600755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:41.600755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:41.600755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:41.600755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:41.600755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:41.600755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:41.600755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:41.600755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:41.600755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:41.601662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:41.602528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:41.602528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:41.602528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:41.602528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:41.604512 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 326/644] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:41.610792 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd319a2-be98-4f8e-a3a3-a59ca7a82c95 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:41.679200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:41.725529 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd319a2-be98-4f8e-a3a3-a59ca7a82c95 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:41.763201 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a9f27-b63b-4546-96c8-e27790609d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:41.763801 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a9f27-b63b-4546-96c8-e27790609d03 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:41.764118 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a9f27-b63b-4546-96c8-e27790609d03 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:41.764401 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a9f27-b63b-4546-96c8-e27790609d03 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:41.765239 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a9f27-b63b-4546-96c8-e27790609d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:41.765881 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a9f27-b63b-4546-96c8-e27790609d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:41.767284 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a9f27-b63b-4546-96c8-e27790609d03 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:41.782562 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 319/645] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:41.788210 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49990e-78e1-44db-9830-bd1a8f211fe5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:41.898314 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49990e-78e1-44db-9830-bd1a8f211fe5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:41.922222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:41.935088 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da42f0-e19a-43f6-8a05-efa4538c3099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:41.936957 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da42f0-e19a-43f6-8a05-efa4538c3099 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:41.937827 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da42f0-e19a-43f6-8a05-efa4538c3099 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:41.938305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da42f0-e19a-43f6-8a05-efa4538c3099 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:41.946652 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da42f0-e19a-43f6-8a05-efa4538c3099 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:41.948332 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da42f0-e19a-43f6-8a05-efa4538c3099 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-69da42f0-e19a-43f6-8a05-efa4538c3099 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:48:41.962954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:41.963992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:41.965675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:41.965675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:41.965675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:48:41.965675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:48:41.965675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:48:41.965675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:48:41.965675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:48:41.965675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:48:41.965675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:48:41.965675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:41.968286 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 327/646] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Jul 14 11:48:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:41.974103 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a9f27-b63b-4546-96c8-e27790609d03 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:42.086737 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a9f27-b63b-4546-96c8-e27790609d03 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:42.111573 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:42.123373 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d17f5-7453-4e80-90b9-01ff61b3972d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:42.124555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d17f5-7453-4e80-90b9-01ff61b3972d None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:42.125248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d17f5-7453-4e80-90b9-01ff61b3972d None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:42.125530 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d17f5-7453-4e80-90b9-01ff61b3972d None admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:42.126416 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d17f5-7453-4e80-90b9-01ff61b3972d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:42.126733 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d17f5-7453-4e80-90b9-01ff61b3972d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:42.128186 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d17f5-7453-4e80-90b9-01ff61b3972d None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:42.148169 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 320/647] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Jul 14 11:48:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:42.154392 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da42f0-e19a-43f6-8a05-efa4538c3099 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:42.196867 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df406670-60b2-4a2d-96f5-2dabb687cd76 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:42.197202 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df406670-60b2-4a2d-96f5-2dabb687cd76 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:42.197488 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df406670-60b2-4a2d-96f5-2dabb687cd76 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:42.199219 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 321/648] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:48:42.205012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab9074-c1d6-48d4-8116-d31c209a2c3c None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:42.205420 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab9074-c1d6-48d4-8116-d31c209a2c3c None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:42.205802 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab9074-c1d6-48d4-8116-d31c209a2c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:42.223304 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-91ab9074-c1d6-48d4-8116-d31c209a2c3c None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:42.224610 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-91ab9074-c1d6-48d4-8116-d31c209a2c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:42.269692 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da42f0-e19a-43f6-8a05-efa4538c3099 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:42.300027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 322/649] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:48:42.307289 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa6c4e-8203-4135-9d89-f481d4425fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:42.308143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa6c4e-8203-4135-9d89-f481d4425fbe None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:42.308707 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa6c4e-8203-4135-9d89-f481d4425fbe None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:42.309148 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa6c4e-8203-4135-9d89-f481d4425fbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:42.319995 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab9074-c1d6-48d4-8116-d31c209a2c3c None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:42.364593 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:42.387125 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa6c4e-8203-4135-9d89-f481d4425fbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:42.388829 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa6c4e-8203-4135-9d89-f481d4425fbe None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:42.424848 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab9074-c1d6-48d4-8116-d31c209a2c3c None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:42.438675 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:42.461550 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad4b28-f2e1-4599-8577-035b82914377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:42.462481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad4b28-f2e1-4599-8577-035b82914377 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:42.462866 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad4b28-f2e1-4599-8577-035b82914377 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:42.463243 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad4b28-f2e1-4599-8577-035b82914377 None admin] PATH_INFO: `/v3/services/image` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:42.464097 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad4b28-f2e1-4599-8577-035b82914377 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:42.465595 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad4b28-f2e1-4599-8577-035b82914377 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-8fad4b28-f2e1-4599-8577-035b82914377 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:42.479491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:42.481127 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:42.481962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:42.481962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:42.481962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:42.481962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:42.481962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:42.481962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:42.481962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:42.481962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:42.481962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:42.481962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:42.481962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:48:42.481962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:42.481962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:48:42.481962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:42.481962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 323/650] 10.222.0.49 () {56 vars in 1105 bytes} [Thu Jul 14 11:48:42 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:42.487459 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad4b28-f2e1-4599-8577-035b82914377 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:42.510021 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 328/651] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:42.511308 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa6c4e-8203-4135-9d89-f481d4425fbe None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:42.598048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad4b28-f2e1-4599-8577-035b82914377 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:42.612201 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:42.634643 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa6c4e-8203-4135-9d89-f481d4425fbe None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:42.635024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935f05f-d6e2-4880-b87d-5f816bd3a8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:42.635869 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935f05f-d6e2-4880-b87d-5f816bd3a8c1 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:42.636269 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935f05f-d6e2-4880-b87d-5f816bd3a8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:42.636616 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935f05f-d6e2-4880-b87d-5f816bd3a8c1 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:42.637985 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935f05f-d6e2-4880-b87d-5f816bd3a8c1 None admin] RBAC: Adding query filter params (name=image) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:42.638452 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935f05f-d6e2-4880-b87d-5f816bd3a8c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:42.640148 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935f05f-d6e2-4880-b87d-5f816bd3a8c1 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:42.649691 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 324/652] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:42.650961 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935f05f-d6e2-4880-b87d-5f816bd3a8c1 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:42.674861 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f89b75-0463-4c42-921c-4493f6f7a56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:42.676063 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f89b75-0463-4c42-921c-4493f6f7a56c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:42.676667 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f89b75-0463-4c42-921c-4493f6f7a56c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:42.677236 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f89b75-0463-4c42-921c-4493f6f7a56c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:42.689499 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f89b75-0463-4c42-921c-4493f6f7a56c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:42.691496 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f89b75-0463-4c42-921c-4493f6f7a56c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:42.696418 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:42.712679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-d1f89b75-0463-4c42-921c-4493f6f7a56c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:42.712679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:42.712679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:42.712679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:42.712679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:42.712679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:42.712679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:42.712679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:42.712679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:42.712679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:42.712679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:42.712679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:42.712679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:42.712679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:42.712679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:42.713620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:42.714493 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:42.714493 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:42.714493 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:42.714493 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:42.722170 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 329/653] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:42.723490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f89b75-0463-4c42-921c-4493f6f7a56c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:42.759221 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935f05f-d6e2-4880-b87d-5f816bd3a8c1 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:42.803838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc584d9-9e30-42fe-8e65-fbd29d182e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:42.804549 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc584d9-9e30-42fe-8e65-fbd29d182e29 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:42.804835 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc584d9-9e30-42fe-8e65-fbd29d182e29 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:42.805112 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc584d9-9e30-42fe-8e65-fbd29d182e29 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:42.805836 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc584d9-9e30-42fe-8e65-fbd29d182e29 None admin] RBAC: Adding query filter params (type=image) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:42.806147 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc584d9-9e30-42fe-8e65-fbd29d182e29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:42.807542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc584d9-9e30-42fe-8e65-fbd29d182e29 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:42.823923 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 325/654] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:42.823923 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d586eb-66b4-441f-9f1d-5c0275e19881 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:42.823923 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d586eb-66b4-441f-9f1d-5c0275e19881 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:42.823923 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d586eb-66b4-441f-9f1d-5c0275e19881 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:42.824334 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 326/655] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:42.827165 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461170be-39fc-4b1a-b032-fbba9e37e6cd None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:42.827455 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461170be-39fc-4b1a-b032-fbba9e37e6cd None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:42.827733 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461170be-39fc-4b1a-b032-fbba9e37e6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:42.857425 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f89b75-0463-4c42-921c-4493f6f7a56c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:42.857792 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-461170be-39fc-4b1a-b032-fbba9e37e6cd None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:42.859999 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-461170be-39fc-4b1a-b032-fbba9e37e6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:42.902459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5e81a-a749-4006-ba52-7ca348c46032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:42.903624 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5e81a-a749-4006-ba52-7ca348c46032 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:42.903865 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5e81a-a749-4006-ba52-7ca348c46032 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:42.904371 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5e81a-a749-4006-ba52-7ca348c46032 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:42.905113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5e81a-a749-4006-ba52-7ca348c46032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:42.905425 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5e81a-a749-4006-ba52-7ca348c46032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:42.906818 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5e81a-a749-4006-ba52-7ca348c46032 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:42.908721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:42.923083 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 330/656] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:42.928848 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5e81a-a749-4006-ba52-7ca348c46032 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:42.964614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 327/657] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:42.969564 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f514e-21a7-4487-87bd-4dc23020db99 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:42.969853 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f514e-21a7-4487-87bd-4dc23020db99 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:42.970138 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f514e-21a7-4487-87bd-4dc23020db99 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:42.976112 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 328/658] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:42.977619 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb88ff-d599-4d4f-89d0-c353afecd81f None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:42.977911 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb88ff-d599-4d4f-89d0-c353afecd81f None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:42.978188 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb88ff-d599-4d4f-89d0-c353afecd81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:42.997799 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-20bb88ff-d599-4d4f-89d0-c353afecd81f None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:42.999030 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-20bb88ff-d599-4d4f-89d0-c353afecd81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:43.033052 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:43.046982 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5e81a-a749-4006-ba52-7ca348c46032 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:43.077400 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 329/659] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:43.078259 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb88ff-d599-4d4f-89d0-c353afecd81f None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:43.084879 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7531a7-8aad-412c-9618-c0305a665ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:43.085928 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7531a7-8aad-412c-9618-c0305a665ae8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:43.086407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7531a7-8aad-412c-9618-c0305a665ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:43.086877 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7531a7-8aad-412c-9618-c0305a665ae8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:43.094691 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7531a7-8aad-412c-9618-c0305a665ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:43.096507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7531a7-8aad-412c-9618-c0305a665ae8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:43.111864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-6b7531a7-8aad-412c-9618-c0305a665ae8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:43.111864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:43.111864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:43.111864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:43.111864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:43.111864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:43.111864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:43.111864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:43.111864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:43.111864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:43.111864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:43.111864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:43.111864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:48:43.111864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:48:43.111864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:43.112779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:43.113639 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:48:43.113639 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:48:43.113639 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:48:43.113639 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:48:43.113639 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:48:43.113639 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:48:43.113639 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:43.113639 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:43.116425 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 331/660] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:43.122547 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7531a7-8aad-412c-9618-c0305a665ae8 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:43.189334 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:43.219442 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb88ff-d599-4d4f-89d0-c353afecd81f None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:43.240182 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7531a7-8aad-412c-9618-c0305a665ae8 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:43.259112 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0cd5a-a582-4812-b756-2cfcfc80206e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:43.260013 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0cd5a-a582-4812-b756-2cfcfc80206e None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:43.260353 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0cd5a-a582-4812-b756-2cfcfc80206e None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:43.260640 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0cd5a-a582-4812-b756-2cfcfc80206e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:43.261298 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0cd5a-a582-4812-b756-2cfcfc80206e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:43.262923 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0cd5a-a582-4812-b756-2cfcfc80206e None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:43.275567 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b040be-b98f-4d04-b0ba-9a565702cfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-eae0cd5a-a582-4812-b756-2cfcfc80206e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:43.275714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:43.276614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:43.277434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:43.277434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:43.277434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:43.277434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:43.277434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:43.277434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:43.277434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:43.277434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:43.277434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:43.277434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:43.277434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:43.277434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:48:43.277434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:43.277434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:48:43.277434 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:43.278741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b040be-b98f-4d04-b0ba-9a565702cfb5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:43.278741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b040be-b98f-4d04-b0ba-9a565702cfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:43.278741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b040be-b98f-4d04-b0ba-9a565702cfb5 None admin] PATH_INFO: `/v3/services/network` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:43.278741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b040be-b98f-4d04-b0ba-9a565702cfb5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:43.279209 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b040be-b98f-4d04-b0ba-9a565702cfb5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:43.282382 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 330/661] 10.222.0.49 () {56 vars in 1129 bytes} [Thu Jul 14 11:48:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:43.283126 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0cd5a-a582-4812-b756-2cfcfc80206e None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-64b040be-b98f-4d04-b0ba-9a565702cfb5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:43.294119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:43.295207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:43.297672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:43.297672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:43.297672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:43.297672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:43.297672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:43.297672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:43.297672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:43.297672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:43.297672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:43.297672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:43.297672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:48:43.297672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:43.297672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:48:43.297672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:43.297672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 332/662] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:43 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:43.298947 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b040be-b98f-4d04-b0ba-9a565702cfb5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:43.319789 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:43.395541 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0cd5a-a582-4812-b756-2cfcfc80206e None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:43.414831 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b040be-b98f-4d04-b0ba-9a565702cfb5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:43.432894 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3bada-0de7-44a6-bd2b-1b1e7d996562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:43.433489 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3bada-0de7-44a6-bd2b-1b1e7d996562 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:43.433778 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3bada-0de7-44a6-bd2b-1b1e7d996562 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:43.434059 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3bada-0de7-44a6-bd2b-1b1e7d996562 None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:43.434938 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3bada-0de7-44a6-bd2b-1b1e7d996562 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:43.435255 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3bada-0de7-44a6-bd2b-1b1e7d996562 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:43.436740 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3bada-0de7-44a6-bd2b-1b1e7d996562 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:43.437265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:43.449747 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 331/663] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:48:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:43.451148 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3bada-0de7-44a6-bd2b-1b1e7d996562 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:43.461604 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970c9ad-b882-451b-8847-d38bc7a58e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:43.462270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970c9ad-b882-451b-8847-d38bc7a58e4e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:43.462556 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970c9ad-b882-451b-8847-d38bc7a58e4e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:43.462837 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970c9ad-b882-451b-8847-d38bc7a58e4e None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:43.463648 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970c9ad-b882-451b-8847-d38bc7a58e4e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:43.463847 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970c9ad-b882-451b-8847-d38bc7a58e4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:43.465252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970c9ad-b882-451b-8847-d38bc7a58e4e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:43.475333 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 333/664] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Jul 14 11:48:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:43.475333 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970c9ad-b882-451b-8847-d38bc7a58e4e None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:43.546259 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:43.561060 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3bada-0de7-44a6-bd2b-1b1e7d996562 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:43.585507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970c9ad-b882-451b-8847-d38bc7a58e4e None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:43.599298 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5016b03-e14e-4dd4-bde7-fa3a6e39f84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:43.599996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5016b03-e14e-4dd4-bde7-fa3a6e39f84e None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:43.600287 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5016b03-e14e-4dd4-bde7-fa3a6e39f84e None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:43.600570 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5016b03-e14e-4dd4-bde7-fa3a6e39f84e None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:43.601274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5016b03-e14e-4dd4-bde7-fa3a6e39f84e None admin] RBAC: Adding query filter params (name=network) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:43.601587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5016b03-e14e-4dd4-bde7-fa3a6e39f84e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:43.602952 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5016b03-e14e-4dd4-bde7-fa3a6e39f84e None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:43.608026 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 332/665] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 14 11:48:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:43.608817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5016b03-e14e-4dd4-bde7-fa3a6e39f84e None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:43.630636 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27972b18-fe40-47f6-a9e9-fd523aa7ecd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:43.631552 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27972b18-fe40-47f6-a9e9-fd523aa7ecd5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:43.632023 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27972b18-fe40-47f6-a9e9-fd523aa7ecd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:43.632443 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27972b18-fe40-47f6-a9e9-fd523aa7ecd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:43.633403 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27972b18-fe40-47f6-a9e9-fd523aa7ecd5 None admin] RBAC: Adding query filter params (role.id=321ee52ce1bc4eafa201f23f55f23d2b, scope.project.id=b711bbd57a5446a39ee7c2cf96356083, user.id=6fd8e197398e465aa3247d2ea89430d8) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:43.633872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27972b18-fe40-47f6-a9e9-fd523aa7ecd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:43.635313 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27972b18-fe40-47f6-a9e9-fd523aa7ecd5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:43.641931 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 334/666] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:48:43 2022] GET /identity/v3/role_assignments?user.id=6fd8e197398e465aa3247d2ea89430d8&scope.project.id=b711bbd57a5446a39ee7c2cf96356083&role.id=321ee52ce1bc4eafa201f23f55f23d2b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:43.642734 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27972b18-fe40-47f6-a9e9-fd523aa7ecd5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:43.746880 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5016b03-e14e-4dd4-bde7-fa3a6e39f84e None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:43.788848 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afb76b-e354-45ef-8b79-93798ec2b5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:43.790267 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afb76b-e354-45ef-8b79-93798ec2b5f2 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:43.790630 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afb76b-e354-45ef-8b79-93798ec2b5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:43.790982 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afb76b-e354-45ef-8b79-93798ec2b5f2 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:43.792284 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afb76b-e354-45ef-8b79-93798ec2b5f2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:43.792708 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afb76b-e354-45ef-8b79-93798ec2b5f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:43.795553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afb76b-e354-45ef-8b79-93798ec2b5f2 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:43.802991 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 333/667] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Jul 14 11:48:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:43.845543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:43.915998 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27972b18-fe40-47f6-a9e9-fd523aa7ecd5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:43.955921 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8c3e0-ab31-4452-b3cc-4708761611a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:43.956548 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8c3e0-ab31-4452-b3cc-4708761611a2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:43.956837 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8c3e0-ab31-4452-b3cc-4708761611a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:43.957116 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8c3e0-ab31-4452-b3cc-4708761611a2 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:43.957841 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8c3e0-ab31-4452-b3cc-4708761611a2 None admin] RBAC: Adding query filter params (type=network) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:43.958154 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8c3e0-ab31-4452-b3cc-4708761611a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:43.959571 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8c3e0-ab31-4452-b3cc-4708761611a2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:43.972103 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 335/668] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 14 11:48:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:45.150784 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaecd3d-5334-4dcb-9d64-37716b9ddc57 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:45.151299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaecd3d-5334-4dcb-9d64-37716b9ddc57 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:45.151409 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaecd3d-5334-4dcb-9d64-37716b9ddc57 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:45.152976 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 334/669] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:45.158642 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa8803-5aad-4f24-90e5-067822838954 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:45.159155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa8803-5aad-4f24-90e5-067822838954 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:45.159232 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa8803-5aad-4f24-90e5-067822838954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:45.184218 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-beaa8803-5aad-4f24-90e5-067822838954 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:45.192705 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-beaa8803-5aad-4f24-90e5-067822838954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:45.266476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 336/670] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:48:45.290103 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaecd3d-5334-4dcb-9d64-37716b9ddc57 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:45.309291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:45.400369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaecd3d-5334-4dcb-9d64-37716b9ddc57 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:45.435516 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdf660-c182-4929-88d2-e7a22c6307c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:45.436827 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf660-c182-4929-88d2-e7a22c6307c4 None admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:45.437258 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf660-c182-4929-88d2-e7a22c6307c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:45.437540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf660-c182-4929-88d2-e7a22c6307c4 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:45.438266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdf660-c182-4929-88d2-e7a22c6307c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:45.439655 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdf660-c182-4929-88d2-e7a22c6307c4 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:45.456850 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 335/671] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 14 11:48:45 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:48:46.037861 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fef23d-378b-4fdf-b83f-624ca5512817 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:46.038438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fef23d-378b-4fdf-b83f-624ca5512817 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:46.038832 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fef23d-378b-4fdf-b83f-624ca5512817 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:46.040645 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 337/672] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:46.046723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ce9f8-0adc-452c-9a9c-c07bf350f247 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:46.047020 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ce9f8-0adc-452c-9a9c-c07bf350f247 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:46.047309 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ce9f8-0adc-452c-9a9c-c07bf350f247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:46.065740 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-101ce9f8-0adc-452c-9a9c-c07bf350f247 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:46.067017 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-101ce9f8-0adc-452c-9a9c-c07bf350f247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:46.149106 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1684ad-4b7c-491b-96a7-c0e1eedf0301 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:46.149565 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1684ad-4b7c-491b-96a7-c0e1eedf0301 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:46.149850 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1684ad-4b7c-491b-96a7-c0e1eedf0301 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:46.151645 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 338/673] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:46.157833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44b842-5f40-49f5-8365-503e0c831a71 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:46.158136 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44b842-5f40-49f5-8365-503e0c831a71 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:46.158383 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44b842-5f40-49f5-8365-503e0c831a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:46.160057 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 336/674] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:46 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:46.183724 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ce9f8-0adc-452c-9a9c-c07bf350f247 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:46.186264 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:46.192217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-9a44b842-5f40-49f5-8365-503e0c831a71 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:46.194305 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9a44b842-5f40-49f5-8365-503e0c831a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:46.243498 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:46.293240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 339/675] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:46 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:48:46.309312 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ce9f8-0adc-452c-9a9c-c07bf350f247 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:46.320074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd41af5-d571-4431-bd48-cb07a0678846 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:46.320666 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd41af5-d571-4431-bd48-cb07a0678846 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:46.321168 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd41af5-d571-4431-bd48-cb07a0678846 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:46.322722 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 340/676] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:48:46.323625 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd41af5-d571-4431-bd48-cb07a0678846 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:46.351807 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda6576-acd8-4623-b598-b20d3ce2f11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:46.352637 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda6576-acd8-4623-b598-b20d3ce2f11b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:46.352925 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda6576-acd8-4623-b598-b20d3ce2f11b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:46.353198 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda6576-acd8-4623-b598-b20d3ce2f11b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:46.364299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda6576-acd8-4623-b598-b20d3ce2f11b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-deda6576-acd8-4623-b598-b20d3ce2f11b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:46.373247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:46.374760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:46.375577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:46.375577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:46.375577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:46.375577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:46.375577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:46.375577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:46.375577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:46.375577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:46.375577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:46.375577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:46.375577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:48:46.375577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:46.375577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 337/677] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:48:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:46.376885 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f34c1f-da0a-47da-ba70-29b10765e87a None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:46.376885 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f34c1f-da0a-47da-ba70-29b10765e87a None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:46.376885 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f34c1f-da0a-47da-ba70-29b10765e87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:46.393919 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-40f34c1f-da0a-47da-ba70-29b10765e87a None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:46.395117 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-40f34c1f-da0a-47da-ba70-29b10765e87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:46.441148 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd41af5-d571-4431-bd48-cb07a0678846 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:46.455438 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:46.468479 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 338/678] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:46 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:46.469433 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f34c1f-da0a-47da-ba70-29b10765e87a None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:46.481978 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab66b8-ed25-43b1-ad29-d8b680c5b0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:46.483035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab66b8-ed25-43b1-ad29-d8b680c5b0cf None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:46.483568 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab66b8-ed25-43b1-ad29-d8b680c5b0cf None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:46.484434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab66b8-ed25-43b1-ad29-d8b680c5b0cf None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:46.485821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab66b8-ed25-43b1-ad29-d8b680c5b0cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:46.487985 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab66b8-ed25-43b1-ad29-d8b680c5b0cf None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:46.505662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 341/679] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 14 11:48:46 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:48:46.506770 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab66b8-ed25-43b1-ad29-d8b680c5b0cf None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:46.544355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:46.607301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f34c1f-da0a-47da-ba70-29b10765e87a None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:46.645040 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab66b8-ed25-43b1-ad29-d8b680c5b0cf None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:46.647835 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f07ac-eef4-4989-b094-5c9ce9c1b36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:46.648631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f07ac-eef4-4989-b094-5c9ce9c1b36e None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:46.648917 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f07ac-eef4-4989-b094-5c9ce9c1b36e None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:46.649246 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f07ac-eef4-4989-b094-5c9ce9c1b36e None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:46.650019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f07ac-eef4-4989-b094-5c9ce9c1b36e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:46.650334 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f07ac-eef4-4989-b094-5c9ce9c1b36e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:46.651830 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f07ac-eef4-4989-b094-5c9ce9c1b36e None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:46.668360 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 339/680] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:46.669802 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f07ac-eef4-4989-b094-5c9ce9c1b36e None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:46.693278 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bc3d0-a2d4-4ea8-bcf6-b61d15ed27a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:46.693958 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bc3d0-a2d4-4ea8-bcf6-b61d15ed27a9 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:46.694247 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bc3d0-a2d4-4ea8-bcf6-b61d15ed27a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:46.694523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bc3d0-a2d4-4ea8-bcf6-b61d15ed27a9 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:46.695252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bc3d0-a2d4-4ea8-bcf6-b61d15ed27a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:46.697438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bc3d0-a2d4-4ea8-bcf6-b61d15ed27a9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:46.714253 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 342/681] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 14 11:48:46 2022] POST /identity/v3/services => generated 240 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:48:46.748546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:46.806401 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f07ac-eef4-4989-b094-5c9ce9c1b36e None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:46.852600 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37532e59-83ca-4fd8-b2a3-6dbbb3cfb3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:46.853401 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37532e59-83ca-4fd8-b2a3-6dbbb3cfb3c8 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:46.853681 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37532e59-83ca-4fd8-b2a3-6dbbb3cfb3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:46.853954 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37532e59-83ca-4fd8-b2a3-6dbbb3cfb3c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:46.866950 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37532e59-83ca-4fd8-b2a3-6dbbb3cfb3c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:46.868474 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37532e59-83ca-4fd8-b2a3-6dbbb3cfb3c8 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:46.887540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-37532e59-83ca-4fd8-b2a3-6dbbb3cfb3c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:46.887540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:46.887540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:46.887540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:46.887540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:46.887540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:46.887540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:46.887540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:46.887540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:46.887540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:46.887540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:46.887540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:46.887540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:46.887540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:46.887540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:46.888528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:46.890668 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:46.890668 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:46.890668 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:46.890668 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:46.890668 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 340/682] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:46.896907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bc3d0-a2d4-4ea8-bcf6-b61d15ed27a9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:47.001586 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:47.020787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bc3d0-a2d4-4ea8-bcf6-b61d15ed27a9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:47.057459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44605778-2305-4951-a3e8-8a6a95868a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:47.058042 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44605778-2305-4951-a3e8-8a6a95868a3b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:47.058325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44605778-2305-4951-a3e8-8a6a95868a3b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:47.058601 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44605778-2305-4951-a3e8-8a6a95868a3b None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:47.059316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44605778-2305-4951-a3e8-8a6a95868a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:47.059725 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44605778-2305-4951-a3e8-8a6a95868a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:47.061120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44605778-2305-4951-a3e8-8a6a95868a3b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:47.074099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 343/683] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:47.080101 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37532e59-83ca-4fd8-b2a3-6dbbb3cfb3c8 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:47.185057 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37532e59-83ca-4fd8-b2a3-6dbbb3cfb3c8 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:47.188413 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:47.222481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431c5ca-68a7-4831-8d28-fd452b75f5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:47.223360 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431c5ca-68a7-4831-8d28-fd452b75f5c1 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:47.223647 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431c5ca-68a7-4831-8d28-fd452b75f5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:47.223942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431c5ca-68a7-4831-8d28-fd452b75f5c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:47.233495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431c5ca-68a7-4831-8d28-fd452b75f5c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:47.235306 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431c5ca-68a7-4831-8d28-fd452b75f5c1 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-9431c5ca-68a7-4831-8d28-fd452b75f5c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:48:47.249924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:47.250888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:47.251815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:47.251815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:47.251815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:48:47.251815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:48:47.251815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:48:47.251815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:48:47.251815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:48:47.251815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:48:47.251815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:48:47.251815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:47.251815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 341/684] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Jul 14 11:48:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:47.258798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44605778-2305-4951-a3e8-8a6a95868a3b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:47.376695 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44605778-2305-4951-a3e8-8a6a95868a3b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:47.411873 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ed0bc-aad9-496c-8261-242761adba78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:47.412948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ed0bc-aad9-496c-8261-242761adba78 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:47.413438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ed0bc-aad9-496c-8261-242761adba78 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:47.413917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ed0bc-aad9-496c-8261-242761adba78 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:47.414949 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ed0bc-aad9-496c-8261-242761adba78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:47.415463 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ed0bc-aad9-496c-8261-242761adba78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:47.417200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ed0bc-aad9-496c-8261-242761adba78 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:47.440342 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 344/685] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Jul 14 11:48:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:47.442450 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431c5ca-68a7-4831-8d28-fd452b75f5c1 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:47.546901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431c5ca-68a7-4831-8d28-fd452b75f5c1 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:47.582922 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f454f97-2c64-4076-8522-def17be2a488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:47.584121 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f454f97-2c64-4076-8522-def17be2a488 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:47.584611 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f454f97-2c64-4076-8522-def17be2a488 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:47.585089 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f454f97-2c64-4076-8522-def17be2a488 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:47.596460 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f454f97-2c64-4076-8522-def17be2a488 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:47.598157 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f454f97-2c64-4076-8522-def17be2a488 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:47.616998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-1f454f97-2c64-4076-8522-def17be2a488 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:47.616998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:47.616998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:47.616998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:47.616998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:47.616998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:47.616998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:47.616998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:47.616998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:47.616998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:47.616998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:47.616998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:47.616998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:47.616998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:47.616998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:47.617912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:47.618788 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:47.618788 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:47.618788 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:47.618788 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:47.621048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 342/686] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:47.627367 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ed0bc-aad9-496c-8261-242761adba78 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:47.632231 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:47.739629 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ed0bc-aad9-496c-8261-242761adba78 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:47.778244 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80b4e0-664a-48d8-ab3d-6c196d7574f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:47.779296 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80b4e0-664a-48d8-ab3d-6c196d7574f7 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:47.779786 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80b4e0-664a-48d8-ab3d-6c196d7574f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:47.780318 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80b4e0-664a-48d8-ab3d-6c196d7574f7 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:47.781450 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80b4e0-664a-48d8-ab3d-6c196d7574f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:47.782121 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80b4e0-664a-48d8-ab3d-6c196d7574f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:47.783781 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80b4e0-664a-48d8-ab3d-6c196d7574f7 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:47.799444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 345/687] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:47.805246 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f454f97-2c64-4076-8522-def17be2a488 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:47.816614 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf500c-08fe-4484-b636-8f54cf3cf611 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:47.817254 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf500c-08fe-4484-b636-8f54cf3cf611 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:47.817733 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf500c-08fe-4484-b636-8f54cf3cf611 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:47.819868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 346/688] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:47.827192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c9663-4433-4240-8a99-21c32f7aba6c None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:47.827483 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c9663-4433-4240-8a99-21c32f7aba6c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:47.827767 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c9663-4433-4240-8a99-21c32f7aba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:47.828981 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:47.850782 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-615c9663-4433-4240-8a99-21c32f7aba6c None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:47.852729 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-615c9663-4433-4240-8a99-21c32f7aba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:47.920953 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f454f97-2c64-4076-8522-def17be2a488 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:47.934450 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:47.951920 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 347/689] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:47 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:48:47.963418 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6075648-e1ea-4a46-b3a0-3de362177a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:47.964317 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6075648-e1ea-4a46-b3a0-3de362177a20 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:47.964608 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6075648-e1ea-4a46-b3a0-3de362177a20 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:47.964891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6075648-e1ea-4a46-b3a0-3de362177a20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:47.972740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c9663-4433-4240-8a99-21c32f7aba6c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:47.973510 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6075648-e1ea-4a46-b3a0-3de362177a20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:47.975318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6075648-e1ea-4a46-b3a0-3de362177a20 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:47.992009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-c6075648-e1ea-4a46-b3a0-3de362177a20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:47.992009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:47.992009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:47.992009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:47.992009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:47.992009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:47.992009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:47.992009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:47.992009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:47.992009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:47.992009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:47.992009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:47.992009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:48:47.992009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:48:47.992009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:47.992909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:47.993780 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:48:47.993780 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:48:47.993780 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:48:47.993780 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:48:47.993780 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:48:47.993780 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:48:47.993780 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:47.993780 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:47.996415 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 343/690] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:48.005447 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6075648-e1ea-4a46-b3a0-3de362177a20 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:48.102226 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:48.113888 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c9663-4433-4240-8a99-21c32f7aba6c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:48.130528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6075648-e1ea-4a46-b3a0-3de362177a20 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:48.153954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058936e4-077c-4095-8f81-6bfbb71d4eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:48.155140 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058936e4-077c-4095-8f81-6bfbb71d4eca None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:48.155621 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058936e4-077c-4095-8f81-6bfbb71d4eca None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:48.156199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058936e4-077c-4095-8f81-6bfbb71d4eca None admin] PATH_INFO: `/v3/services/image` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:48.157509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058936e4-077c-4095-8f81-6bfbb71d4eca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:48.159199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058936e4-077c-4095-8f81-6bfbb71d4eca None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:48.167482 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a09f2e-746a-4caf-bbdf-84f8e98de479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:48.168196 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a09f2e-746a-4caf-bbdf-84f8e98de479 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:48.168483 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a09f2e-746a-4caf-bbdf-84f8e98de479 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:48.168767 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a09f2e-746a-4caf-bbdf-84f8e98de479 None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:48.169547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a09f2e-746a-4caf-bbdf-84f8e98de479 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:48.169861 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a09f2e-746a-4caf-bbdf-84f8e98de479 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:48.171454 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a09f2e-746a-4caf-bbdf-84f8e98de479 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-058936e4-077c-4095-8f81-6bfbb71d4eca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:48.173775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:48.174710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:48.175534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:48.175534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:48.175534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:48.175534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:48.175534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:48.175534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:48.175534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:48.175534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:48.175534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:48.175534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:48.175534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:48:48.175534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:48.175534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:48:48.175534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:48.183945 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 348/691] 10.222.0.49 () {56 vars in 1105 bytes} [Thu Jul 14 11:48:47 2022] GET /identity/v3/services/image => generated 86 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:48.184134 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058936e4-077c-4095-8f81-6bfbb71d4eca None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:48.190051 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 344/692] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:48:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:48.191055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a09f2e-746a-4caf-bbdf-84f8e98de479 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:48.267999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:48.302857 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a09f2e-746a-4caf-bbdf-84f8e98de479 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:48.316250 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058936e4-077c-4095-8f81-6bfbb71d4eca None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:48.338984 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c77fa2-7c17-4ebd-9b50-52c6e78c8699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:48.340219 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c77fa2-7c17-4ebd-9b50-52c6e78c8699 None admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:48.340707 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c77fa2-7c17-4ebd-9b50-52c6e78c8699 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:48.341184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c77fa2-7c17-4ebd-9b50-52c6e78c8699 None admin] PATH_INFO: `/v3/projects/b711bbd57a5446a39ee7c2cf96356083/users/6fd8e197398e465aa3247d2ea89430d8/roles/321ee52ce1bc4eafa201f23f55f23d2b` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:48.343468 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c77fa2-7c17-4ebd-9b50-52c6e78c8699 None admin] RBAC: Authorizing `identity:create_grant(project_id=b711bbd57a5446a39ee7c2cf96356083, user_id=6fd8e197398e465aa3247d2ea89430d8, role_id=321ee52ce1bc4eafa201f23f55f23d2b)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:48.345725 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c77fa2-7c17-4ebd-9b50-52c6e78c8699 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:48.348241 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:48.354975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580423c6-d42f-46bd-91c8-2bd1b02ce50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:48.355621 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580423c6-d42f-46bd-91c8-2bd1b02ce50d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:48.355974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580423c6-d42f-46bd-91c8-2bd1b02ce50d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:48.356256 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580423c6-d42f-46bd-91c8-2bd1b02ce50d None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:48.357007 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580423c6-d42f-46bd-91c8-2bd1b02ce50d None admin] RBAC: Adding query filter params (name=image) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:48.357341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580423c6-d42f-46bd-91c8-2bd1b02ce50d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:48.358725 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580423c6-d42f-46bd-91c8-2bd1b02ce50d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:48.370142 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 349/694] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:48.370142 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580423c6-d42f-46bd-91c8-2bd1b02ce50d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:48.370555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 345/694] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:48:48 2022] PUT /identity/v3/projects/b711bbd57a5446a39ee7c2cf96356083/users/6fd8e197398e465aa3247d2ea89430d8/roles/321ee52ce1bc4eafa201f23f55f23d2b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:48:48.486173 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580423c6-d42f-46bd-91c8-2bd1b02ce50d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:48.512655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:48.526802 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295e9f4-87d0-4451-be8f-07782c8bdd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:48.527484 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e9f4-87d0-4451-be8f-07782c8bdd6f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:48.527772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e9f4-87d0-4451-be8f-07782c8bdd6f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:48.528087 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e9f4-87d0-4451-be8f-07782c8bdd6f None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:48.528803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295e9f4-87d0-4451-be8f-07782c8bdd6f None admin] RBAC: Adding query filter params (type=image) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:48.529110 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295e9f4-87d0-4451-be8f-07782c8bdd6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:48.530506 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295e9f4-87d0-4451-be8f-07782c8bdd6f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:48.542548 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 350/695] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:48.543905 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c77fa2-7c17-4ebd-9b50-52c6e78c8699 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:48.661644 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c77fa2-7c17-4ebd-9b50-52c6e78c8699 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:48.697038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5a37a-7de4-43df-a919-f56ff8987f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:48.698115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5a37a-7de4-43df-a919-f56ff8987f7b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:48.698622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5a37a-7de4-43df-a919-f56ff8987f7b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:48.699073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5a37a-7de4-43df-a919-f56ff8987f7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:48.700056 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5a37a-7de4-43df-a919-f56ff8987f7b None admin] RBAC: Adding query filter params (interface=public, service_id=746b2d88f55f4bbbb90662a91dd133bb, region_id=RegionOne) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:48.700574 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5a37a-7de4-43df-a919-f56ff8987f7b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:48.702098 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5a37a-7de4-43df-a919-f56ff8987f7b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:48.710949 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 346/696] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Jul 14 11:48:48 2022] GET /identity/v3/endpoints?service_id=746b2d88f55f4bbbb90662a91dd133bb&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:48.716578 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295e9f4-87d0-4451-be8f-07782c8bdd6f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:48.826846 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295e9f4-87d0-4451-be8f-07782c8bdd6f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:48.864741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7906e94-ab86-4e23-a9ab-4e244a9c193f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:48.865713 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7906e94-ab86-4e23-a9ab-4e244a9c193f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:48.866176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7906e94-ab86-4e23-a9ab-4e244a9c193f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:48.866630 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7906e94-ab86-4e23-a9ab-4e244a9c193f None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:48.867480 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7906e94-ab86-4e23-a9ab-4e244a9c193f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:48.869122 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7906e94-ab86-4e23-a9ab-4e244a9c193f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:48.875416 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 351/697] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 14 11:48:48 2022] GET /identity/v3/services => generated 1002 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:48:48.975263 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037c05d-781b-4021-90b8-628ba8489850 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:48.975567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037c05d-781b-4021-90b8-628ba8489850 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:48.975843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037c05d-781b-4021-90b8-628ba8489850 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:48.977606 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 347/698] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:48.983293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bddf93-019e-4bae-8eaa-df3eb918fe60 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:48.983870 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bddf93-019e-4bae-8eaa-df3eb918fe60 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:48.984369 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bddf93-019e-4bae-8eaa-df3eb918fe60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:49.003199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a4bddf93-019e-4bae-8eaa-df3eb918fe60 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:49.004828 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a4bddf93-019e-4bae-8eaa-df3eb918fe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:49.060566 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:49.086118 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 352/699] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:48 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:48:49.110471 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037c05d-781b-4021-90b8-628ba8489850 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:49.176309 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:49.227211 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037c05d-781b-4021-90b8-628ba8489850 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:49.238382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b3b98-08ec-4b46-8b77-bde1ffdd8c98 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:49.239002 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b3b98-08ec-4b46-8b77-bde1ffdd8c98 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:49.239488 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b3b98-08ec-4b46-8b77-bde1ffdd8c98 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:49.241391 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 353/700] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:49.246772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfebd49-3559-42ac-8483-8f31900acc9a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:49.247344 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfebd49-3559-42ac-8483-8f31900acc9a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:49.247844 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfebd49-3559-42ac-8483-8f31900acc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:49.264464 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d4fb5-8511-408e-a68c-03493ff0ca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:49.265286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d4fb5-8511-408e-a68c-03493ff0ca19 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:49.265563 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d4fb5-8511-408e-a68c-03493ff0ca19 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:49.265847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d4fb5-8511-408e-a68c-03493ff0ca19 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:49.267165 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d4fb5-8511-408e-a68c-03493ff0ca19 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:49.268421 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d4fb5-8511-408e-a68c-03493ff0ca19 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:49.272903 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ebfebd49-3559-42ac-8483-8f31900acc9a None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:49.274699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ebfebd49-3559-42ac-8483-8f31900acc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-9e4d4fb5-8511-408e-a68c-03493ff0ca19 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:49.281181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:49.283463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:49.284378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 348/701] 10.222.0.49 () {56 vars in 1129 bytes} [Thu Jul 14 11:48:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:49.288714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d4fb5-8511-408e-a68c-03493ff0ca19 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:49.367921 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 354/702] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:49 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:48:49.387206 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfebd49-3559-42ac-8483-8f31900acc9a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:49.411577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d4fb5-8511-408e-a68c-03493ff0ca19 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:49.443983 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:49.463254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568307b-b403-4989-bd15-f1197cf25c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:49.463958 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568307b-b403-4989-bd15-f1197cf25c09 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:49.464252 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568307b-b403-4989-bd15-f1197cf25c09 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:49.464533 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568307b-b403-4989-bd15-f1197cf25c09 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:49.465239 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568307b-b403-4989-bd15-f1197cf25c09 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:49.465553 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568307b-b403-4989-bd15-f1197cf25c09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:49.467176 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568307b-b403-4989-bd15-f1197cf25c09 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:49.474887 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 349/703] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Jul 14 11:48:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:49.480069 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568307b-b403-4989-bd15-f1197cf25c09 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:49.512257 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfebd49-3559-42ac-8483-8f31900acc9a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:49.524423 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:49.551038 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ea8c4-6c19-4448-a9a1-03a9a1ef8484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:49.551837 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ea8c4-6c19-4448-a9a1-03a9a1ef8484 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:49.552217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ea8c4-6c19-4448-a9a1-03a9a1ef8484 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:49.552610 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ea8c4-6c19-4448-a9a1-03a9a1ef8484 None admin] PATH_INFO: `/v3/services/network` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:49.553265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ea8c4-6c19-4448-a9a1-03a9a1ef8484 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:49.554766 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ea8c4-6c19-4448-a9a1-03a9a1ef8484 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-c00ea8c4-6c19-4448-a9a1-03a9a1ef8484 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:49.567375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:49.568613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:49.569907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:49.569907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:49.569907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:49.569907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:49.569907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:49.569907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:49.569907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:49.569907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:49.569907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:49.569907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:49.569907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:48:49.569907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:49.569907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:48:49.569907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:49.569907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 355/704] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:49 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:49.576688 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ea8c4-6c19-4448-a9a1-03a9a1ef8484 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:49.606154 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568307b-b403-4989-bd15-f1197cf25c09 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:49.643873 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9448982-9130-41dd-8715-24e39868f751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:49.644949 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9448982-9130-41dd-8715-24e39868f751 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:49.645357 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9448982-9130-41dd-8715-24e39868f751 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:49.645732 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9448982-9130-41dd-8715-24e39868f751 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:49.646537 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9448982-9130-41dd-8715-24e39868f751 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:49.646946 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9448982-9130-41dd-8715-24e39868f751 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:49.648460 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9448982-9130-41dd-8715-24e39868f751 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:49.658982 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 350/705] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Jul 14 11:48:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:49.660173 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9448982-9130-41dd-8715-24e39868f751 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:49.696448 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ea8c4-6c19-4448-a9a1-03a9a1ef8484 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:49.718006 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:49.743087 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964197f6-b8a3-4155-8bc6-8f5356738b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:49.744011 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964197f6-b8a3-4155-8bc6-8f5356738b67 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:49.744314 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964197f6-b8a3-4155-8bc6-8f5356738b67 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:49.744712 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964197f6-b8a3-4155-8bc6-8f5356738b67 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:49.745428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964197f6-b8a3-4155-8bc6-8f5356738b67 None admin] RBAC: Adding query filter params (name=network) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:49.745740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964197f6-b8a3-4155-8bc6-8f5356738b67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:49.748108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964197f6-b8a3-4155-8bc6-8f5356738b67 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:49.753630 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 356/706] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 14 11:48:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:49.759093 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964197f6-b8a3-4155-8bc6-8f5356738b67 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:49.776589 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9448982-9130-41dd-8715-24e39868f751 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:49.812727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:49.816010 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa45d8-c5e3-49bc-b3ca-64f3aa0a50b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:49.816955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa45d8-c5e3-49bc-b3ca-64f3aa0a50b6 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:49.817450 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa45d8-c5e3-49bc-b3ca-64f3aa0a50b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:49.817943 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa45d8-c5e3-49bc-b3ca-64f3aa0a50b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:49.818926 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa45d8-c5e3-49bc-b3ca-64f3aa0a50b6 None admin] RBAC: Adding query filter params (interface=public, service_id=18970497464940488c0e8b67489d3aa9, region_id=RegionOne) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:49.819453 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa45d8-c5e3-49bc-b3ca-64f3aa0a50b6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:49.821348 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa45d8-c5e3-49bc-b3ca-64f3aa0a50b6 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:49.833585 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 351/707] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Jul 14 11:48:49 2022] GET /identity/v3/endpoints?service_id=18970497464940488c0e8b67489d3aa9&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:49.834748 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa45d8-c5e3-49bc-b3ca-64f3aa0a50b6 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:49.883041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964197f6-b8a3-4155-8bc6-8f5356738b67 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:49.920852 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67754c-d222-4330-9047-971cc05d1b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:49.921501 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67754c-d222-4330-9047-971cc05d1b8f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:49.921772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67754c-d222-4330-9047-971cc05d1b8f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:49.922061 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67754c-d222-4330-9047-971cc05d1b8f None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:49.922775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67754c-d222-4330-9047-971cc05d1b8f None admin] RBAC: Adding query filter params (type=network) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:49.923612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67754c-d222-4330-9047-971cc05d1b8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:49.925693 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67754c-d222-4330-9047-971cc05d1b8f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:49.936083 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 357/708] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 14 11:48:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:49.936936 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67754c-d222-4330-9047-971cc05d1b8f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:49.948238 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa45d8-c5e3-49bc-b3ca-64f3aa0a50b6 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:49.964248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:49.987080 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09bdc0-cedd-42af-8b52-cab8951d1d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:49.987885 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09bdc0-cedd-42af-8b52-cab8951d1d66 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:49.988304 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09bdc0-cedd-42af-8b52-cab8951d1d66 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:49.988681 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09bdc0-cedd-42af-8b52-cab8951d1d66 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:49.989656 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09bdc0-cedd-42af-8b52-cab8951d1d66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:49.991190 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09bdc0-cedd-42af-8b52-cab8951d1d66 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:50.004219 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 352/709] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 14 11:48:49 2022] GET /identity/v3/services => generated 1002 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:48:50.058607 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67754c-d222-4330-9047-971cc05d1b8f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:50.060813 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:50.103325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745977f2-d86a-4526-b7ed-40842ca4d4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:50.104049 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745977f2-d86a-4526-b7ed-40842ca4d4b9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:50.104348 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745977f2-d86a-4526-b7ed-40842ca4d4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:50.104636 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745977f2-d86a-4526-b7ed-40842ca4d4b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:50.105524 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745977f2-d86a-4526-b7ed-40842ca4d4b9 None admin] RBAC: Adding query filter params (interface=public, service_id=62e3ac9d87a94bab85dcfdb6136a8c53, region_id=RegionOne) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:50.105852 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745977f2-d86a-4526-b7ed-40842ca4d4b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:50.107330 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745977f2-d86a-4526-b7ed-40842ca4d4b9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:50.117268 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 358/710] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Jul 14 11:48:49 2022] GET /identity/v3/endpoints?service_id=62e3ac9d87a94bab85dcfdb6136a8c53&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:50.122825 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09bdc0-cedd-42af-8b52-cab8951d1d66 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:50.249944 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09bdc0-cedd-42af-8b52-cab8951d1d66 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:50.290885 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2de4e0-36c0-45b7-9df9-0d6b6e2c5873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:50.291801 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2de4e0-36c0-45b7-9df9-0d6b6e2c5873 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:50.292260 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2de4e0-36c0-45b7-9df9-0d6b6e2c5873 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:50.292684 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2de4e0-36c0-45b7-9df9-0d6b6e2c5873 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:50.293507 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2de4e0-36c0-45b7-9df9-0d6b6e2c5873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:50.295050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2de4e0-36c0-45b7-9df9-0d6b6e2c5873 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:50.301915 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 353/711] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 14 11:48:50 2022] GET /identity/v3/services => generated 1002 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:48:50.918975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7bce6-4337-45e1-924b-a4c9d64345f4 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:50.920452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7bce6-4337-45e1-924b-a4c9d64345f4 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:50.921142 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7bce6-4337-45e1-924b-a4c9d64345f4 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:50.925085 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 359/712] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:50.934133 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c8abe-6271-4764-b7c5-c57f8818c316 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:50.934740 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c8abe-6271-4764-b7c5-c57f8818c316 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:50.935244 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c8abe-6271-4764-b7c5-c57f8818c316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:50.953771 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-bb3c8abe-6271-4764-b7c5-c57f8818c316 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:50.955442 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-bb3c8abe-6271-4764-b7c5-c57f8818c316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:50.996422 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:51.029873 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 354/713] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:50 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:48:51.056142 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7bce6-4337-45e1-924b-a4c9d64345f4 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:51.171308 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7bce6-4337-45e1-924b-a4c9d64345f4 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:51.222150 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f440a-5791-4655-bd23-14fbfb6e6e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:51.222953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f440a-5791-4655-bd23-14fbfb6e6e46 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:51.223256 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f440a-5791-4655-bd23-14fbfb6e6e46 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:51.223518 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f440a-5791-4655-bd23-14fbfb6e6e46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:51.234440 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f440a-5791-4655-bd23-14fbfb6e6e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:48:51.241477 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1c0a7-b410-40db-94ff-a39d834fe7b7 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:51.241791 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1c0a7-b410-40db-94ff-a39d834fe7b7 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:51.242048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1c0a7-b410-40db-94ff-a39d834fe7b7 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-119f440a-5791-4655-bd23-14fbfb6e6e46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:48:51.243428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:51.244917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:51.245805 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:51.245805 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:51.245805 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:51.245805 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:51.245805 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:48:51.245805 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:48:51.245805 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:48:51.245805 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:48:51.245805 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:48:51.245805 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:48:51.245805 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:48:51.245805 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:51.246892 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 355/714] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:51.246967 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 360/715] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:48:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:51.250496 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1c0a7-b410-40db-94ff-a39d834fe7b7 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:51.251186 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc4542-d6f9-4fed-a5bf-bd2a926a8a1b None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:51.251344 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc4542-d6f9-4fed-a5bf-bd2a926a8a1b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:51.251517 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc4542-d6f9-4fed-a5bf-bd2a926a8a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:51.272618 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-aacc4542-d6f9-4fed-a5bf-bd2a926a8a1b None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:51.274052 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-aacc4542-d6f9-4fed-a5bf-bd2a926a8a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:51.297340 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:51.352136 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 361/716] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:51 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:48:51.372172 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1c0a7-b410-40db-94ff-a39d834fe7b7 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:51.376259 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc4542-d6f9-4fed-a5bf-bd2a926a8a1b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:51.412332 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dc5b2-28a9-4340-a82e-e90c7d31448c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:51.413277 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dc5b2-28a9-4340-a82e-e90c7d31448c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:51.413565 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dc5b2-28a9-4340-a82e-e90c7d31448c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:51.413873 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dc5b2-28a9-4340-a82e-e90c7d31448c None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:51.415481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dc5b2-28a9-4340-a82e-e90c7d31448c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:51.415998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dc5b2-28a9-4340-a82e-e90c7d31448c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:51.417385 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dc5b2-28a9-4340-a82e-e90c7d31448c None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:51.428368 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 356/717] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:48:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:51.433996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dc5b2-28a9-4340-a82e-e90c7d31448c None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:51.478565 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:51.492437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc4542-d6f9-4fed-a5bf-bd2a926a8a1b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:51.529722 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bb511-841b-42e3-b529-edb67f723366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:51.530524 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bb511-841b-42e3-b529-edb67f723366 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:51.530806 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bb511-841b-42e3-b529-edb67f723366 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:51.531081 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bb511-841b-42e3-b529-edb67f723366 None admin] PATH_INFO: `/v3/services/image` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:51.531740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bb511-841b-42e3-b529-edb67f723366 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:51.533187 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bb511-841b-42e3-b529-edb67f723366 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-cd0bb511-841b-42e3-b529-edb67f723366 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:51.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:51.548728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:51.549589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:51.549589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:51.549589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:51.549589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:51.549589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:51.549589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:51.549589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:51.549589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:51.549589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:51.549589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:51.549589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:48:51.549589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:51.549589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:48:51.549589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:51.549589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 362/718] 10.222.0.49 () {56 vars in 1105 bytes} [Thu Jul 14 11:48:51 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:51.555002 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bb511-841b-42e3-b529-edb67f723366 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:51.564865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dc5b2-28a9-4340-a82e-e90c7d31448c None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:51.578942 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:51.614045 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d8e4-a440-4152-a73a-99a6f095489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:51.615227 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d8e4-a440-4152-a73a-99a6f095489d None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:51.615628 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d8e4-a440-4152-a73a-99a6f095489d None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:51.616248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d8e4-a440-4152-a73a-99a6f095489d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:51.632823 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6d8e4-a440-4152-a73a-99a6f095489d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:51.634503 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6d8e4-a440-4152-a73a-99a6f095489d None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:51.666506 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bb511-841b-42e3-b529-edb67f723366 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:51.677019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-b0d6d8e4-a440-4152-a73a-99a6f095489d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:51.677019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:51.677019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:51.677019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:51.677019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:51.677019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:51.677019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:51.677019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:51.677019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:51.677019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:51.677019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:51.677019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:51.677019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:51.677019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:51.677019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:51.678067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:51.678984 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:51.678984 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:51.678984 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:51.678984 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:51.681629 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 357/719] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:51.688668 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d8e4-a440-4152-a73a-99a6f095489d None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:51.714063 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db000b4-7958-4f1f-9d91-124825565983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:51.714884 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db000b4-7958-4f1f-9d91-124825565983 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:51.715274 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db000b4-7958-4f1f-9d91-124825565983 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:51.715676 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db000b4-7958-4f1f-9d91-124825565983 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:51.720437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db000b4-7958-4f1f-9d91-124825565983 None admin] RBAC: Adding query filter params (name=image) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:51.720876 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db000b4-7958-4f1f-9d91-124825565983 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:51.722433 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db000b4-7958-4f1f-9d91-124825565983 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:51.728134 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 363/720] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:51.733825 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db000b4-7958-4f1f-9d91-124825565983 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:51.830017 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:51.851597 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db000b4-7958-4f1f-9d91-124825565983 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:51.874518 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:51.891819 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d8e4-a440-4152-a73a-99a6f095489d None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:51.903561 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7b6ab-ee88-4e6f-bec7-97921f68765f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:51.904739 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7b6ab-ee88-4e6f-bec7-97921f68765f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:51.905104 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7b6ab-ee88-4e6f-bec7-97921f68765f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:51.905720 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7b6ab-ee88-4e6f-bec7-97921f68765f None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:51.906518 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7b6ab-ee88-4e6f-bec7-97921f68765f None admin] RBAC: Adding query filter params (type=image) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:51.906905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7b6ab-ee88-4e6f-bec7-97921f68765f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:51.910122 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7b6ab-ee88-4e6f-bec7-97921f68765f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:51.917385 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 364/721] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:51.923266 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7b6ab-ee88-4e6f-bec7-97921f68765f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:51.932357 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27896b52-d9f4-4162-a00c-13241be3d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:51.933274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27896b52-d9f4-4162-a00c-13241be3d268 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:51.933753 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27896b52-d9f4-4162-a00c-13241be3d268 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:51.934211 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27896b52-d9f4-4162-a00c-13241be3d268 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:51.935114 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27896b52-d9f4-4162-a00c-13241be3d268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:51.935603 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27896b52-d9f4-4162-a00c-13241be3d268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:51.937289 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27896b52-d9f4-4162-a00c-13241be3d268 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:51.952399 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 358/722] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:51.958525 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27896b52-d9f4-4162-a00c-13241be3d268 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:52.052962 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7b6ab-ee88-4e6f-bec7-97921f68765f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:52.092095 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df3663-bd52-42f8-a707-a738f066ec47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:52.093093 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df3663-bd52-42f8-a707-a738f066ec47 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:52.093591 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df3663-bd52-42f8-a707-a738f066ec47 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:52.094073 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df3663-bd52-42f8-a707-a738f066ec47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:52.095008 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df3663-bd52-42f8-a707-a738f066ec47 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:52.096036 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27896b52-d9f4-4162-a00c-13241be3d268 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:52.097494 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df3663-bd52-42f8-a707-a738f066ec47 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:52.122424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 365/723] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 14 11:48:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:48:52.148594 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b1d70-61c4-4b2b-a595-9a0c61cb0d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:52.149472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b1d70-61c4-4b2b-a595-9a0c61cb0d4f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:52.149760 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b1d70-61c4-4b2b-a595-9a0c61cb0d4f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:52.150037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b1d70-61c4-4b2b-a595-9a0c61cb0d4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:52.159667 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b1d70-61c4-4b2b-a595-9a0c61cb0d4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:52.161499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b1d70-61c4-4b2b-a595-9a0c61cb0d4f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-bd1b1d70-61c4-4b2b-a595-9a0c61cb0d4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:48:52.179141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:52.180128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:52.181115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:52.181115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:52.181115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:48:52.181115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:48:52.181115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:48:52.181115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:48:52.181115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:48:52.181115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:48:52.181115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:48:52.181115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:52.181115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 359/724] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Jul 14 11:48:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:52.187164 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df3663-bd52-42f8-a707-a738f066ec47 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:52.193909 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:52.315980 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df3663-bd52-42f8-a707-a738f066ec47 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:52.357356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822b1a4-cb45-424f-8efc-d63f72e4fb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:52.358057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822b1a4-cb45-424f-8efc-d63f72e4fb7c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:52.358353 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822b1a4-cb45-424f-8efc-d63f72e4fb7c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:52.358706 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822b1a4-cb45-424f-8efc-d63f72e4fb7c None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:52.359575 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822b1a4-cb45-424f-8efc-d63f72e4fb7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:52.359914 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822b1a4-cb45-424f-8efc-d63f72e4fb7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:52.361423 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822b1a4-cb45-424f-8efc-d63f72e4fb7c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:52.381094 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 366/725] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Jul 14 11:48:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:52.387009 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b1d70-61c4-4b2b-a595-9a0c61cb0d4f None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:52.390079 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:52.494617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b1d70-61c4-4b2b-a595-9a0c61cb0d4f None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:52.499373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c9c51-53ec-4096-92ac-1cec8f88f3f5 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:52.499662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c9c51-53ec-4096-92ac-1cec8f88f3f5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:52.499980 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c9c51-53ec-4096-92ac-1cec8f88f3f5 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:52.501606 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 367/726] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:52.507118 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b584321-e1ae-4a1e-9c7e-2cd812184a69 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:52.507405 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b584321-e1ae-4a1e-9c7e-2cd812184a69 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:52.507679 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b584321-e1ae-4a1e-9c7e-2cd812184a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:52.526594 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-2b584321-e1ae-4a1e-9c7e-2cd812184a69 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:52.527779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-2b584321-e1ae-4a1e-9c7e-2cd812184a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:52.539848 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494e931-cd4c-4fda-8bef-0ba752af7d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:52.540840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494e931-cd4c-4fda-8bef-0ba752af7d4b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:52.541132 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494e931-cd4c-4fda-8bef-0ba752af7d4b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:52.541420 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494e931-cd4c-4fda-8bef-0ba752af7d4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:52.594206 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:52.608036 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 368/727] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:52 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:48:52.632934 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b584321-e1ae-4a1e-9c7e-2cd812184a69 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:52.651346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494e931-cd4c-4fda-8bef-0ba752af7d4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:52.653171 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494e931-cd4c-4fda-8bef-0ba752af7d4b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:52.655804 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:52.747872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b584321-e1ae-4a1e-9c7e-2cd812184a69 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:52.786692 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abeed57-b8ac-4b3f-981d-7bd961ee6f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:52.787749 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeed57-b8ac-4b3f-981d-7bd961ee6f53 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:52.788138 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeed57-b8ac-4b3f-981d-7bd961ee6f53 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:52.788509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeed57-b8ac-4b3f-981d-7bd961ee6f53 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:52.789236 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abeed57-b8ac-4b3f-981d-7bd961ee6f53 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:52.790871 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abeed57-b8ac-4b3f-981d-7bd961ee6f53 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-1abeed57-b8ac-4b3f-981d-7bd961ee6f53 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:52.804194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:52.805132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:52.805965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:52.805965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:52.805965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:52.805965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:52.805965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:52.805965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:52.805965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:52.805965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:52.805965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:52.805965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:52.805965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:52.805965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:48:52.805965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:52.805965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:48:52.805965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:52.806810 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 360/729] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:52 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:48:52.806882 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 369/729] 10.222.0.49 () {56 vars in 1129 bytes} [Thu Jul 14 11:48:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:52.811286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494e931-cd4c-4fda-8bef-0ba752af7d4b None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:52.811425 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abeed57-b8ac-4b3f-981d-7bd961ee6f53 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:52.874150 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:52.925554 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abeed57-b8ac-4b3f-981d-7bd961ee6f53 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:52.933139 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494e931-cd4c-4fda-8bef-0ba752af7d4b None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:52.934811 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:52.979713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915632e2-83ee-4e04-b663-93f862b28b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:52.980574 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915632e2-83ee-4e04-b663-93f862b28b2b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:52.980868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa657aa5-d563-4e47-b9f9-1c8989912e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:52.981051 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915632e2-83ee-4e04-b663-93f862b28b2b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:52.981215 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915632e2-83ee-4e04-b663-93f862b28b2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:52.981665 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa657aa5-d563-4e47-b9f9-1c8989912e74 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:52.982151 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa657aa5-d563-4e47-b9f9-1c8989912e74 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:52.982608 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa657aa5-d563-4e47-b9f9-1c8989912e74 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:52.983882 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa657aa5-d563-4e47-b9f9-1c8989912e74 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:52.984404 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa657aa5-d563-4e47-b9f9-1c8989912e74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:52.986573 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa657aa5-d563-4e47-b9f9-1c8989912e74 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:52.992990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915632e2-83ee-4e04-b663-93f862b28b2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:52.999055 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 370/730] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Jul 14 11:48:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:52.999177 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915632e2-83ee-4e04-b663-93f862b28b2b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:52.999252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969dab-fa72-4095-9ac6-f94e67928da0 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:52.999252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969dab-fa72-4095-9ac6-f94e67928da0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:52.999252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969dab-fa72-4095-9ac6-f94e67928da0 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:52.999252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 371/731] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:53.000213 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969dab-fa72-4095-9ac6-f94e67928da0 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:53.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-915632e2-83ee-4e04-b663-93f862b28b2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:53.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:53.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:53.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:53.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:53.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:53.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:53.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:53.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:53.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:53.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:53.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:53.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:53.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:53.021561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:53.022472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:53.023354 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:53.023354 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:53.023354 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:53.023354 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:53.027522 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 361/732] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:48:53.028852 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5112d3c-624b-4151-811b-fe703b18c57f None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:53.029147 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5112d3c-624b-4151-811b-fe703b18c57f None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:53.029427 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5112d3c-624b-4151-811b-fe703b18c57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:53.047044 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-f5112d3c-624b-4151-811b-fe703b18c57f None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:53.048340 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-f5112d3c-624b-4151-811b-fe703b18c57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:53.121788 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 362/733] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:53 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:48:53.122964 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5112d3c-624b-4151-811b-fe703b18c57f None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:53.132641 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969dab-fa72-4095-9ac6-f94e67928da0 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:53.158107 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:53.175513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41677f47-b542-494a-b2b0-018341a5c612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:53.176418 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41677f47-b542-494a-b2b0-018341a5c612 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:53.176712 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41677f47-b542-494a-b2b0-018341a5c612 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:53.176995 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41677f47-b542-494a-b2b0-018341a5c612 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:53.177719 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41677f47-b542-494a-b2b0-018341a5c612 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:53.178030 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41677f47-b542-494a-b2b0-018341a5c612 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:53.179541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41677f47-b542-494a-b2b0-018341a5c612 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:53.189833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 372/734] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Jul 14 11:48:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:53.189833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41677f47-b542-494a-b2b0-018341a5c612 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:53.306573 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41677f47-b542-494a-b2b0-018341a5c612 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:53.352087 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:53.360535 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef8ad3-b98e-4142-87bc-5dc851a76bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:53.361729 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef8ad3-b98e-4142-87bc-5dc851a76bce None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:53.362170 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef8ad3-b98e-4142-87bc-5dc851a76bce None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:53.362614 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef8ad3-b98e-4142-87bc-5dc851a76bce None admin] PATH_INFO: `/v3/services/network` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:53.363637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef8ad3-b98e-4142-87bc-5dc851a76bce None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:53.365821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef8ad3-b98e-4142-87bc-5dc851a76bce None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:53.370272 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5112d3c-624b-4151-811b-fe703b18c57f None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-84ef8ad3-b98e-4142-87bc-5dc851a76bce None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:53.384681 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:53.385699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:53.386541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:53.386541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:53.386541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:53.386541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:53.386541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:53.386541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:53.386541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:53.386541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:53.386541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:53.386541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:53.386541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:48:53.386541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:53.386541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:48:53.386541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:53.387289 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 373/735] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:53 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:53.387873 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef8ad3-b98e-4142-87bc-5dc851a76bce None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:53.417066 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550d8ae-5a18-45cc-9b8a-d0bd148c975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:53.417731 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550d8ae-5a18-45cc-9b8a-d0bd148c975a None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:53.418021 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550d8ae-5a18-45cc-9b8a-d0bd148c975a None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:53.418298 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550d8ae-5a18-45cc-9b8a-d0bd148c975a None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:53.419026 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550d8ae-5a18-45cc-9b8a-d0bd148c975a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:53.419336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550d8ae-5a18-45cc-9b8a-d0bd148c975a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:53.420753 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550d8ae-5a18-45cc-9b8a-d0bd148c975a None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:53.433284 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 363/736] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:53.434118 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550d8ae-5a18-45cc-9b8a-d0bd148c975a None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:53.446436 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:53.500850 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef8ad3-b98e-4142-87bc-5dc851a76bce None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:53.535701 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6814e6e-eba4-444d-b3f3-2819f96ac4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:53.536387 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6814e6e-eba4-444d-b3f3-2819f96ac4af None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:53.536676 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6814e6e-eba4-444d-b3f3-2819f96ac4af None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:53.536974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6814e6e-eba4-444d-b3f3-2819f96ac4af None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:53.537691 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6814e6e-eba4-444d-b3f3-2819f96ac4af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:53.539060 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6814e6e-eba4-444d-b3f3-2819f96ac4af None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:53.552928 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550d8ae-5a18-45cc-9b8a-d0bd148c975a None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:53.557859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 374/737] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 14 11:48:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:48:53.558616 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6814e6e-eba4-444d-b3f3-2819f96ac4af None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:53.608487 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8b0ed-7e70-4e8a-a916-a663ad625008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:53.609423 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8b0ed-7e70-4e8a-a916-a663ad625008 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:53.609851 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8b0ed-7e70-4e8a-a916-a663ad625008 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:53.610268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8b0ed-7e70-4e8a-a916-a663ad625008 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:53.611303 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8b0ed-7e70-4e8a-a916-a663ad625008 None admin] RBAC: Adding query filter params (name=network) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:53.611613 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8b0ed-7e70-4e8a-a916-a663ad625008 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:53.613700 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8b0ed-7e70-4e8a-a916-a663ad625008 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:53.619925 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 364/738] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 14 11:48:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:53.625498 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8b0ed-7e70-4e8a-a916-a663ad625008 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:53.630934 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:53.707740 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6814e6e-eba4-444d-b3f3-2819f96ac4af None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:53.711194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:53.750597 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9557d-b58c-4037-a803-293906d03626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:53.752211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9557d-b58c-4037-a803-293906d03626 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:53.752716 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9557d-b58c-4037-a803-293906d03626 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:53.753207 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9557d-b58c-4037-a803-293906d03626 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:53.763431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8b0ed-7e70-4e8a-a916-a663ad625008 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:53.765363 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9557d-b58c-4037-a803-293906d03626 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:53.767494 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9557d-b58c-4037-a803-293906d03626 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:53.784564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-e5b9557d-b58c-4037-a803-293906d03626 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:53.784564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:53.784564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:53.784564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:53.784564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:53.784564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:53.784564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:53.784564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:53.784564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:53.784564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:53.784564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:53.784564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:53.784564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:48:53.784564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:48:53.784564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:53.786316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:53.787226 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:48:53.787226 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:48:53.787226 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:48:53.787226 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:48:53.787226 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:48:53.787226 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:48:53.787226 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:48:53.787226 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:53.790080 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 375/739] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:48:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:53.795474 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9557d-b58c-4037-a803-293906d03626 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:53.806073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45072fd1-5642-4fd0-866c-b1d12617dad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:53.806746 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45072fd1-5642-4fd0-866c-b1d12617dad3 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:53.807037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45072fd1-5642-4fd0-866c-b1d12617dad3 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:53.807320 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45072fd1-5642-4fd0-866c-b1d12617dad3 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:53.808134 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45072fd1-5642-4fd0-866c-b1d12617dad3 None admin] RBAC: Adding query filter params (type=network) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:53.808403 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45072fd1-5642-4fd0-866c-b1d12617dad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:53.810267 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45072fd1-5642-4fd0-866c-b1d12617dad3 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:53.818421 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 365/740] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 14 11:48:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:53.824264 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45072fd1-5642-4fd0-866c-b1d12617dad3 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:53.923735 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:53.934056 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9557d-b58c-4037-a803-293906d03626 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:53.957414 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45072fd1-5642-4fd0-866c-b1d12617dad3 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:53.979036 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19aece-a39d-437d-acbd-4e6fcbc4884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:53.980259 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19aece-a39d-437d-acbd-4e6fcbc4884d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:53.980695 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19aece-a39d-437d-acbd-4e6fcbc4884d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:53.981189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19aece-a39d-437d-acbd-4e6fcbc4884d None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:53.982121 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19aece-a39d-437d-acbd-4e6fcbc4884d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:53.982619 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19aece-a39d-437d-acbd-4e6fcbc4884d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:53.985005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19aece-a39d-437d-acbd-4e6fcbc4884d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:54.000087 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e27bd-7190-437d-95cc-87814acead20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:54.000913 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e27bd-7190-437d-95cc-87814acead20 None admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:54.001302 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e27bd-7190-437d-95cc-87814acead20 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:54.001680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e27bd-7190-437d-95cc-87814acead20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:54.007470 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 376/741] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:48:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:54.007601 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e27bd-7190-437d-95cc-87814acead20 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:54.007601 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e27bd-7190-437d-95cc-87814acead20 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:54.008802 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19aece-a39d-437d-acbd-4e6fcbc4884d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:54.033461 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 366/742] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 14 11:48:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:48:54.041409 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:54.139162 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19aece-a39d-437d-acbd-4e6fcbc4884d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:54.186362 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae68fa-fcd0-45ac-a5c4-6e8af9c78d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:54.187343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae68fa-fcd0-45ac-a5c4-6e8af9c78d04 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:54.187775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae68fa-fcd0-45ac-a5c4-6e8af9c78d04 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:54.188226 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae68fa-fcd0-45ac-a5c4-6e8af9c78d04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:54.189300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae68fa-fcd0-45ac-a5c4-6e8af9c78d04 None admin] RBAC: Adding query filter params (role.id=321ee52ce1bc4eafa201f23f55f23d2b, scope.project.id=b711bbd57a5446a39ee7c2cf96356083, user.id=6fd8e197398e465aa3247d2ea89430d8) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:54.189791 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae68fa-fcd0-45ac-a5c4-6e8af9c78d04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:54.191457 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae68fa-fcd0-45ac-a5c4-6e8af9c78d04 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:54.199218 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 377/743] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:48:54 2022] GET /identity/v3/role_assignments?user.id=6fd8e197398e465aa3247d2ea89430d8&scope.project.id=b711bbd57a5446a39ee7c2cf96356083&role.id=321ee52ce1bc4eafa201f23f55f23d2b => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:54.481531 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8c24d-f000-44ec-b8c2-8016d7987de1 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:54.482031 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8c24d-f000-44ec-b8c2-8016d7987de1 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:54.482031 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8c24d-f000-44ec-b8c2-8016d7987de1 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:54.483416 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 367/744] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:54.489130 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c39c48-acf0-4f91-b5ff-cc38f7b1f93c None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:54.489570 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c39c48-acf0-4f91-b5ff-cc38f7b1f93c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:54.489860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c39c48-acf0-4f91-b5ff-cc38f7b1f93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:54.508197 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-f2c39c48-acf0-4f91-b5ff-cc38f7b1f93c None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:54.509405 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f2c39c48-acf0-4f91-b5ff-cc38f7b1f93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:54.578054 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 378/745] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:54 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:48:54.602927 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8c24d-f000-44ec-b8c2-8016d7987de1 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:54.705718 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8c24d-f000-44ec-b8c2-8016d7987de1 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:54.729870 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:54.743751 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f8001-66e1-44b1-8481-8cd905d63eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:54.744397 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f8001-66e1-44b1-8481-8cd905d63eb0 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:54.744670 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f8001-66e1-44b1-8481-8cd905d63eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:54.744983 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f8001-66e1-44b1-8481-8cd905d63eb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:54.815690 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f8001-66e1-44b1-8481-8cd905d63eb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:54.817392 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f8001-66e1-44b1-8481-8cd905d63eb0 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:54.929051 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 368/746] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:48:54 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:48:54.934828 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c39c48-acf0-4f91-b5ff-cc38f7b1f93c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:54.950992 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:55.038627 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c39c48-acf0-4f91-b5ff-cc38f7b1f93c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:55.072511 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81df9e-ffa8-45c4-891f-1fbc559b962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:55.073581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81df9e-ffa8-45c4-891f-1fbc559b962a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:55.073870 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81df9e-ffa8-45c4-891f-1fbc559b962a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:55.074146 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81df9e-ffa8-45c4-891f-1fbc559b962a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:55.084873 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81df9e-ffa8-45c4-891f-1fbc559b962a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:55.086321 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81df9e-ffa8-45c4-891f-1fbc559b962a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:55.104613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-bc81df9e-ffa8-45c4-891f-1fbc559b962a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:55.104613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:55.104613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:55.104613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:55.104613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:55.104613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:55.104613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:55.104613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:55.104613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:55.104613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:55.104613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:55.104613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:55.104613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:48:55.104613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:48:55.104613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:55.105471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:55.106384 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:48:55.106384 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:48:55.106384 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:48:55.106384 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:55.107109 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 379/747] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:48:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:55.111704 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f8001-66e1-44b1-8481-8cd905d63eb0 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:55.137194 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:55.221943 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f8001-66e1-44b1-8481-8cd905d63eb0 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:55.256909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828ad5-41bc-4eec-9303-207fe9a032f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:55.257567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828ad5-41bc-4eec-9303-207fe9a032f8 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:55.257851 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828ad5-41bc-4eec-9303-207fe9a032f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:55.258126 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828ad5-41bc-4eec-9303-207fe9a032f8 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:55.258839 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b828ad5-41bc-4eec-9303-207fe9a032f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:55.259143 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b828ad5-41bc-4eec-9303-207fe9a032f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:55.260546 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b828ad5-41bc-4eec-9303-207fe9a032f8 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:55.279922 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 369/748] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:56.006864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c6dc8-ff6f-4634-8823-19dfe94134f8 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:56.007394 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c6dc8-ff6f-4634-8823-19dfe94134f8 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:56.007481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c6dc8-ff6f-4634-8823-19dfe94134f8 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:56.008805 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 380/749] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:56.014059 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff63442-9839-47c8-8ece-934986373372 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:56.014461 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff63442-9839-47c8-8ece-934986373372 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:56.014619 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff63442-9839-47c8-8ece-934986373372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:56.031540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-8ff63442-9839-47c8-8ece-934986373372 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:56.032753 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-8ff63442-9839-47c8-8ece-934986373372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:56.101190 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 370/750] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:56 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:48:56.124843 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c6dc8-ff6f-4634-8823-19dfe94134f8 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:56.194666 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:56.230173 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c6dc8-ff6f-4634-8823-19dfe94134f8 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:56.263100 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fe0cc-de05-4bf0-81fc-1618dd1e4385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:56.263815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fe0cc-de05-4bf0-81fc-1618dd1e4385 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:56.264127 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fe0cc-de05-4bf0-81fc-1618dd1e4385 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:56.264404 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fe0cc-de05-4bf0-81fc-1618dd1e4385 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:56.265047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fe0cc-de05-4bf0-81fc-1618dd1e4385 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:56.266411 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fe0cc-de05-4bf0-81fc-1618dd1e4385 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-af5fe0cc-de05-4bf0-81fc-1618dd1e4385 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:56.279058 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:56.280108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:56.281113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:56.281113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:56.281113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:56.281113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:56.281113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:56.281113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:56.281113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:56.281113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:56.281113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:56.281113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:56.281113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:48:56.281113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:56.281113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:48:56.281113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:48:56.281113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 381/751] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:48:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:56.286122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff63442-9839-47c8-8ece-934986373372 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:56.300964 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:56.384138 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff63442-9839-47c8-8ece-934986373372 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:56.418424 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54576c1-2fbe-4763-9d36-a3ffc8a88a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:56.419114 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54576c1-2fbe-4763-9d36-a3ffc8a88a2c None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:56.419396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54576c1-2fbe-4763-9d36-a3ffc8a88a2c None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:56.419674 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54576c1-2fbe-4763-9d36-a3ffc8a88a2c None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:56.420452 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54576c1-2fbe-4763-9d36-a3ffc8a88a2c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:56.420783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54576c1-2fbe-4763-9d36-a3ffc8a88a2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:56.422196 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54576c1-2fbe-4763-9d36-a3ffc8a88a2c None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:56.428203 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 371/752] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:48:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:56.434134 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fe0cc-de05-4bf0-81fc-1618dd1e4385 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:56.534211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fe0cc-de05-4bf0-81fc-1618dd1e4385 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:56.562217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:56.568571 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a2441-87e2-458c-a45d-52551d4cee0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:56.569234 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a2441-87e2-458c-a45d-52551d4cee0a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:56.569520 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a2441-87e2-458c-a45d-52551d4cee0a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:56.569801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a2441-87e2-458c-a45d-52551d4cee0a None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:56.570504 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a2441-87e2-458c-a45d-52551d4cee0a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:56.570813 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a2441-87e2-458c-a45d-52551d4cee0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:56.572290 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a2441-87e2-458c-a45d-52551d4cee0a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:56.577140 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 382/753] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:48:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:48:56.589387 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fae148-bf8e-44e3-bd6b-5eec3a20d634 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:56.589680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fae148-bf8e-44e3-bd6b-5eec3a20d634 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:56.589967 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fae148-bf8e-44e3-bd6b-5eec3a20d634 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:56.591356 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 372/754] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:56.597276 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8161c-c9a6-4036-a6c8-f1aff957466e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:56.597573 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8161c-c9a6-4036-a6c8-f1aff957466e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:56.597858 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8161c-c9a6-4036-a6c8-f1aff957466e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:56.617101 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ccd8161c-c9a6-4036-a6c8-f1aff957466e None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:56.618345 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ccd8161c-c9a6-4036-a6c8-f1aff957466e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:56.690018 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 383/755] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:56 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:48:56.714538 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fae148-bf8e-44e3-bd6b-5eec3a20d634 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:56.800378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:56.823114 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fae148-bf8e-44e3-bd6b-5eec3a20d634 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:56.857429 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575cddd-fd3b-4e40-8fde-f6df0a3abe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:56.858230 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575cddd-fd3b-4e40-8fde-f6df0a3abe44 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:56.858520 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575cddd-fd3b-4e40-8fde-f6df0a3abe44 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:56.858803 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575cddd-fd3b-4e40-8fde-f6df0a3abe44 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:56.859458 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575cddd-fd3b-4e40-8fde-f6df0a3abe44 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:56.860852 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575cddd-fd3b-4e40-8fde-f6df0a3abe44 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-1575cddd-fd3b-4e40-8fde-f6df0a3abe44 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:48:56.873038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:48:56.874135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:48:56.874955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 373/756] 10.222.0.49 () {56 vars in 1132 bytes} [Thu Jul 14 11:48:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:48:56.880057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8161c-c9a6-4036-a6c8-f1aff957466e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:56.983082 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8161c-c9a6-4036-a6c8-f1aff957466e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:57.006627 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:57.017503 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f7155-4f8a-4f72-bc01-8001b399cd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:57.018182 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f7155-4f8a-4f72-bc01-8001b399cd47 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:57.018462 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f7155-4f8a-4f72-bc01-8001b399cd47 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:57.018743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f7155-4f8a-4f72-bc01-8001b399cd47 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:57.019450 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f7155-4f8a-4f72-bc01-8001b399cd47 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:57.019765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f7155-4f8a-4f72-bc01-8001b399cd47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:57.021751 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f7155-4f8a-4f72-bc01-8001b399cd47 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:57.026398 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 384/757] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 14 11:48:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:57.032021 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575cddd-fd3b-4e40-8fde-f6df0a3abe44 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:57.133136 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575cddd-fd3b-4e40-8fde-f6df0a3abe44 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:57.167408 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5aea1-252d-4376-8bd3-d09c298dcb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:57.168107 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5aea1-252d-4376-8bd3-d09c298dcb05 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:57.168395 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5aea1-252d-4376-8bd3-d09c298dcb05 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:57.168674 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5aea1-252d-4376-8bd3-d09c298dcb05 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:57.169373 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5aea1-252d-4376-8bd3-d09c298dcb05 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:48:57.169684 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5aea1-252d-4376-8bd3-d09c298dcb05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:57.171048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5aea1-252d-4376-8bd3-d09c298dcb05 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:57.175995 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 374/758] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 14 11:48:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:48:58.817348 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfee3f-b4cd-425c-acdd-7e7db5c13ac7 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:58.817877 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfee3f-b4cd-425c-acdd-7e7db5c13ac7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:58.817964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfee3f-b4cd-425c-acdd-7e7db5c13ac7 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:58.820155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 385/759] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:58.825628 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5ff64-edab-410d-ad02-1123f99382b5 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:58.826032 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5ff64-edab-410d-ad02-1123f99382b5 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:58.826185 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5ff64-edab-410d-ad02-1123f99382b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:58.837684 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:58.843230 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-56a5ff64-edab-410d-ad02-1123f99382b5 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:58.844969 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-56a5ff64-edab-410d-ad02-1123f99382b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:58.911144 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 375/760] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:58 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:48:58.936615 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfee3f-b4cd-425c-acdd-7e7db5c13ac7 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:59.039637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfee3f-b4cd-425c-acdd-7e7db5c13ac7 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:59.074797 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a863c5a-8d80-46e3-999c-4464b3d458f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:59.075653 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a863c5a-8d80-46e3-999c-4464b3d458f9 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:59.075969 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a863c5a-8d80-46e3-999c-4464b3d458f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:59.076249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a863c5a-8d80-46e3-999c-4464b3d458f9 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:59.077012 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a863c5a-8d80-46e3-999c-4464b3d458f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:59.078378 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a863c5a-8d80-46e3-999c-4464b3d458f9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:59.091676 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 386/761] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 14 11:48:58 2022] POST /identity/v3/services => generated 251 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:48:59.425693 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a5b7d-1e30-4b4f-8326-b42d7090f3ad None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:59.426039 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a5b7d-1e30-4b4f-8326-b42d7090f3ad None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:59.426262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a5b7d-1e30-4b4f-8326-b42d7090f3ad None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:59.427757 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 376/762] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:48:59.436157 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0a780-0450-4175-be98-48c2f2c8a821 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:59.436539 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0a780-0450-4175-be98-48c2f2c8a821 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:59.436834 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0a780-0450-4175-be98-48c2f2c8a821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:59.454952 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c7d0a780-0450-4175-be98-48c2f2c8a821 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:48:59.456174 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c7d0a780-0450-4175-be98-48c2f2c8a821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:48:59.500668 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:59.530754 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 387/763] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:48:59 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:48:59.555563 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a5b7d-1e30-4b4f-8326-b42d7090f3ad None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:48:59.656050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a5b7d-1e30-4b4f-8326-b42d7090f3ad None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:48:59.688889 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0c72f-863e-4d44-bee3-2cea499dcd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:48:59.689474 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0c72f-863e-4d44-bee3-2cea499dcd4f None admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:48:59.689765 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0c72f-863e-4d44-bee3-2cea499dcd4f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:48:59.690041 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0c72f-863e-4d44-bee3-2cea499dcd4f None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:48:59.690748 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0c72f-863e-4d44-bee3-2cea499dcd4f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:48:59.692141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0c72f-863e-4d44-bee3-2cea499dcd4f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:48:59.695829 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:59.708433 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 377/764] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 14 11:48:59 2022] POST /identity/v3/services => generated 269 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:49:01.379980 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fd439-63b0-42de-94b9-d5938e677c9a None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:01.380549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fd439-63b0-42de-94b9-d5938e677c9a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:01.380549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fd439-63b0-42de-94b9-d5938e677c9a None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:01.381903 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 388/765] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:49:01.387165 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b7514-d3d2-4920-9639-8257d5da2214 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:01.387611 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b7514-d3d2-4920-9639-8257d5da2214 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:01.387798 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b7514-d3d2-4920-9639-8257d5da2214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:01.404335 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-d85b7514-d3d2-4920-9639-8257d5da2214 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:49:01.405519 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-d85b7514-d3d2-4920-9639-8257d5da2214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:49:01.479446 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 378/766] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:49:01 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:49:01.503789 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fd439-63b0-42de-94b9-d5938e677c9a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:01.605249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fd439-63b0-42de-94b9-d5938e677c9a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:01.638917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f7be0-9077-44be-b0d7-7ab22d3911ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:01.639704 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f7be0-9077-44be-b0d7-7ab22d3911ab None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:01.640015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f7be0-9077-44be-b0d7-7ab22d3911ab None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:01.640295 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f7be0-9077-44be-b0d7-7ab22d3911ab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:01.640940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f7be0-9077-44be-b0d7-7ab22d3911ab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:01.642301 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f7be0-9077-44be-b0d7-7ab22d3911ab None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-bc3f7be0-9077-44be-b0d7-7ab22d3911ab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:49:01.653849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:49:01.654866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:49:01.655772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:49:01.655772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:49:01.655772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:49:01.655772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:49:01.655772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:49:01.655772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:49:01.655772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:49:01.655772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:49:01.655772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:49:01.655772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:49:01.655772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:49:01.655772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:49:01.655772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:49:01.655772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:01.655772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 389/767] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:49:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:49:01.661065 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b7514-d3d2-4920-9639-8257d5da2214 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:01.765435 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b7514-d3d2-4920-9639-8257d5da2214 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:01.788646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:01.801409 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba6b25-ad64-4307-ae5f-d0aeb8c6404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:01.802069 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba6b25-ad64-4307-ae5f-d0aeb8c6404a None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:01.802353 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba6b25-ad64-4307-ae5f-d0aeb8c6404a None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:01.802630 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba6b25-ad64-4307-ae5f-d0aeb8c6404a None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:01.803332 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba6b25-ad64-4307-ae5f-d0aeb8c6404a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:01.803640 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba6b25-ad64-4307-ae5f-d0aeb8c6404a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:01.805119 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba6b25-ad64-4307-ae5f-d0aeb8c6404a None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:01.809817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 379/768] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:49:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:49:01.815535 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f7be0-9077-44be-b0d7-7ab22d3911ab None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:01.859672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:01.919493 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f7be0-9077-44be-b0d7-7ab22d3911ab None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:01.954005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99026463-58d5-40dd-8ce4-9f8c57260da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:01.954669 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99026463-58d5-40dd-8ce4-9f8c57260da5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:01.954958 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99026463-58d5-40dd-8ce4-9f8c57260da5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:01.955239 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99026463-58d5-40dd-8ce4-9f8c57260da5 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:01.955972 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99026463-58d5-40dd-8ce4-9f8c57260da5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:01.956286 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99026463-58d5-40dd-8ce4-9f8c57260da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:01.957664 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99026463-58d5-40dd-8ce4-9f8c57260da5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:01.962506 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 390/769] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:49:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:49:01.968593 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba6b25-ad64-4307-ae5f-d0aeb8c6404a None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:01.983098 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74af12-4b81-4f5e-8d5b-ba24a46c690c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:01.983393 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74af12-4b81-4f5e-8d5b-ba24a46c690c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:01.983671 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74af12-4b81-4f5e-8d5b-ba24a46c690c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:01.985041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 391/770] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:49:01.989776 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c6546-1a78-4871-af02-05087b3adda7 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:01.990063 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c6546-1a78-4871-af02-05087b3adda7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:01.990349 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c6546-1a78-4871-af02-05087b3adda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:02.007085 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-167c6546-1a78-4871-af02-05087b3adda7 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:49:02.008926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-167c6546-1a78-4871-af02-05087b3adda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:49:02.072006 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba6b25-ad64-4307-ae5f-d0aeb8c6404a None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:02.074598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 392/771] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:49:01 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:49:02.098343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c6546-1a78-4871-af02-05087b3adda7 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:02.106538 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b7e12-378f-4340-8d71-83922fe2aa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:02.107192 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b7e12-378f-4340-8d71-83922fe2aa2b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:02.107480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b7e12-378f-4340-8d71-83922fe2aa2b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:02.107761 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b7e12-378f-4340-8d71-83922fe2aa2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:02.108617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b7e12-378f-4340-8d71-83922fe2aa2b None admin] RBAC: Adding query filter params (interface=public, service_id=7ae6ca202c754ba58284ecc4bbc7745d, region_id=RegionOne) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:02.108940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b7e12-378f-4340-8d71-83922fe2aa2b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:02.111470 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b7e12-378f-4340-8d71-83922fe2aa2b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:02.116775 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 380/772] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Jul 14 11:49:01 2022] GET /identity/v3/endpoints?service_id=7ae6ca202c754ba58284ecc4bbc7745d&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:49:02.123192 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b7e12-378f-4340-8d71-83922fe2aa2b None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:02.130678 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:02.174700 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:02.204586 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c6546-1a78-4871-af02-05087b3adda7 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:02.224748 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b7e12-378f-4340-8d71-83922fe2aa2b None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:02.238670 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f14875-7c08-4ed4-b71f-67321f9b58b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:02.239487 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f14875-7c08-4ed4-b71f-67321f9b58b2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:02.239774 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f14875-7c08-4ed4-b71f-67321f9b58b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:02.240090 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f14875-7c08-4ed4-b71f-67321f9b58b2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:02.240741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f14875-7c08-4ed4-b71f-67321f9b58b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:02.242113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f14875-7c08-4ed4-b71f-67321f9b58b2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-80f14875-7c08-4ed4-b71f-67321f9b58b2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:49:02.254988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:49:02.255977 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:02.256798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 393/773] 10.222.0.49 () {56 vars in 1132 bytes} [Thu Jul 14 11:49:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:49:02.261176 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64c279-2977-478a-b284-a415bb52d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:02.261847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64c279-2977-478a-b284-a415bb52d4b7 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:02.262133 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64c279-2977-478a-b284-a415bb52d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:02.262325 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f14875-7c08-4ed4-b71f-67321f9b58b2 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:02.262431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64c279-2977-478a-b284-a415bb52d4b7 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:02.263075 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64c279-2977-478a-b284-a415bb52d4b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:02.264566 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64c279-2977-478a-b284-a415bb52d4b7 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:02.270681 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 381/774] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 14 11:49:02 2022] GET /identity/v3/services => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:49:02.364547 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:02.371880 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f14875-7c08-4ed4-b71f-67321f9b58b2 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:02.408839 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914e860-52d2-4c60-99cc-345617bcc6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:02.409600 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914e860-52d2-4c60-99cc-345617bcc6d8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:02.409926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914e860-52d2-4c60-99cc-345617bcc6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:02.410208 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914e860-52d2-4c60-99cc-345617bcc6d8 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:02.410931 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914e860-52d2-4c60-99cc-345617bcc6d8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:02.411247 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914e860-52d2-4c60-99cc-345617bcc6d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:02.412689 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914e860-52d2-4c60-99cc-345617bcc6d8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:02.418958 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 394/775] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 14 11:49:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:49:02.424842 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64c279-2977-478a-b284-a415bb52d4b7 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:02.526407 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64c279-2977-478a-b284-a415bb52d4b7 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:02.540482 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:02.561669 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f71c5-cd02-4606-8a5c-9419457d57a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:02.562330 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f71c5-cd02-4606-8a5c-9419457d57a7 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:02.562614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f71c5-cd02-4606-8a5c-9419457d57a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:02.562891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f71c5-cd02-4606-8a5c-9419457d57a7 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:02.563588 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f71c5-cd02-4606-8a5c-9419457d57a7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:02.563911 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f71c5-cd02-4606-8a5c-9419457d57a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:02.565278 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f71c5-cd02-4606-8a5c-9419457d57a7 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:02.570043 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 382/776] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 14 11:49:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:49:02.576539 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914e860-52d2-4c60-99cc-345617bcc6d8 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:02.674273 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914e860-52d2-4c60-99cc-345617bcc6d8 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:02.706776 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d760f-3544-49c8-be2a-2b7df83964e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:02.707429 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d760f-3544-49c8-be2a-2b7df83964e0 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:02.707716 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d760f-3544-49c8-be2a-2b7df83964e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:02.708031 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d760f-3544-49c8-be2a-2b7df83964e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:02.708813 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d760f-3544-49c8-be2a-2b7df83964e0 None admin] RBAC: Adding query filter params (interface=public, service_id=3151ff92259e401d86465bd38259a542, region_id=RegionOne) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:02.709130 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d760f-3544-49c8-be2a-2b7df83964e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:02.710492 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d760f-3544-49c8-be2a-2b7df83964e0 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:02.716176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 395/777] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Jul 14 11:49:02 2022] GET /identity/v3/endpoints?service_id=3151ff92259e401d86465bd38259a542&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:49:02.721481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f71c5-cd02-4606-8a5c-9419457d57a7 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:02.820396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f71c5-cd02-4606-8a5c-9419457d57a7 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:02.854273 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9dd66-3c17-4a90-bacb-c35a9c08c2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:02.854995 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9dd66-3c17-4a90-bacb-c35a9c08c2ba None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:02.855288 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9dd66-3c17-4a90-bacb-c35a9c08c2ba None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:02.855583 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9dd66-3c17-4a90-bacb-c35a9c08c2ba None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:02.856399 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9dd66-3c17-4a90-bacb-c35a9c08c2ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:02.857846 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9dd66-3c17-4a90-bacb-c35a9c08c2ba None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:02.864339 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 383/778] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 14 11:49:02 2022] GET /identity/v3/services => generated 1498 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:49:04.531150 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f602ab-dee2-493f-853e-b284bed5cc5f None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:04.531657 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f602ab-dee2-493f-853e-b284bed5cc5f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:04.531753 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f602ab-dee2-493f-853e-b284bed5cc5f None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:04.533118 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 396/779] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:49:04.538326 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94042c9-ef09-49a6-a815-a0525738e7f5 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:04.538761 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94042c9-ef09-49a6-a815-a0525738e7f5 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:04.538957 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94042c9-ef09-49a6-a815-a0525738e7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:04.556191 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-b94042c9-ef09-49a6-a815-a0525738e7f5 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:49:04.557864 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-b94042c9-ef09-49a6-a815-a0525738e7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:49:04.592403 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:04.626012 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 384/780] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:49:04 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:49:04.652079 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f602ab-dee2-493f-853e-b284bed5cc5f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:04.677779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:04.754966 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f602ab-dee2-493f-853e-b284bed5cc5f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:04.788902 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c4d88-fb14-4ac2-8fe2-ee6728463243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:04.789624 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c4d88-fb14-4ac2-8fe2-ee6728463243 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:04.789909 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c4d88-fb14-4ac2-8fe2-ee6728463243 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:04.790189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c4d88-fb14-4ac2-8fe2-ee6728463243 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:04.791067 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c4d88-fb14-4ac2-8fe2-ee6728463243 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:04.792261 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c4d88-fb14-4ac2-8fe2-ee6728463243 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-430c4d88-fb14-4ac2-8fe2-ee6728463243 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:49:04.803926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:49:04.805114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:49:04.805948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:49:04.805948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:49:04.805948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:49:04.805948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:49:04.805948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:49:04.805948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:49:04.805948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:49:04.805948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:49:04.805948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:49:04.805948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:49:04.805948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:49:04.805948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:49:04.805948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:49:04.805948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:04.805948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 397/781] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:49:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:49:04.811741 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94042c9-ef09-49a6-a815-a0525738e7f5 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:04.909741 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94042c9-ef09-49a6-a815-a0525738e7f5 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:04.946406 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9264b34-92e8-4698-a441-c9f098c31de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:04.947223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9264b34-92e8-4698-a441-c9f098c31de6 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:04.948110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9264b34-92e8-4698-a441-c9f098c31de6 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:04.948394 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9264b34-92e8-4698-a441-c9f098c31de6 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:04.949241 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9264b34-92e8-4698-a441-c9f098c31de6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:04.949561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9264b34-92e8-4698-a441-c9f098c31de6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:04.950971 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9264b34-92e8-4698-a441-c9f098c31de6 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:04.956759 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 385/782] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:49:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:49:04.962561 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c4d88-fb14-4ac2-8fe2-ee6728463243 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:05.055677 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:05.068829 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c4d88-fb14-4ac2-8fe2-ee6728463243 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:05.090600 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b693a-e97d-435a-bb8b-d1addbbb5385 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:05.090891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b693a-e97d-435a-bb8b-d1addbbb5385 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:05.091170 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b693a-e97d-435a-bb8b-d1addbbb5385 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:05.092548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 386/783] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:49:05.097224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebd02d-c38b-4843-82d9-e6a23bdb0be0 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:05.097505 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebd02d-c38b-4843-82d9-e6a23bdb0be0 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:05.097777 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebd02d-c38b-4843-82d9-e6a23bdb0be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:05.104575 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf31021-cf9c-4801-af79-583f730a4b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:05.105365 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf31021-cf9c-4801-af79-583f730a4b0d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:05.105648 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf31021-cf9c-4801-af79-583f730a4b0d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:05.105925 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf31021-cf9c-4801-af79-583f730a4b0d None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:05.106649 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf31021-cf9c-4801-af79-583f730a4b0d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:05.106962 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf31021-cf9c-4801-af79-583f730a4b0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:05.108363 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf31021-cf9c-4801-af79-583f730a4b0d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:05.113283 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 398/784] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 14 11:49:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:49:05.118742 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-9cebd02d-c38b-4843-82d9-e6a23bdb0be0 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:49:05.120065 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-9cebd02d-c38b-4843-82d9-e6a23bdb0be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:49:05.120628 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf31021-cf9c-4801-af79-583f730a4b0d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:05.155618 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:05.195051 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 387/785] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:49:05 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:49:05.220487 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebd02d-c38b-4843-82d9-e6a23bdb0be0 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:05.229288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf31021-cf9c-4801-af79-583f730a4b0d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:05.263199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b53b4f-4c89-4945-8d30-ecc6fc2fa95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:05.263859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b53b4f-4c89-4945-8d30-ecc6fc2fa95b None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:05.264176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b53b4f-4c89-4945-8d30-ecc6fc2fa95b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:05.264455 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b53b4f-4c89-4945-8d30-ecc6fc2fa95b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:05.265195 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b53b4f-4c89-4945-8d30-ecc6fc2fa95b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:05.266562 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b53b4f-4c89-4945-8d30-ecc6fc2fa95b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:05.285031 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 399/786] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 14 11:49:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:49:05.320798 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebd02d-c38b-4843-82d9-e6a23bdb0be0 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:05.365773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ddd0c-a962-4d26-a5bc-af75a5fb6346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:05.366590 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ddd0c-a962-4d26-a5bc-af75a5fb6346 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:05.366873 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ddd0c-a962-4d26-a5bc-af75a5fb6346 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:05.367145 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ddd0c-a962-4d26-a5bc-af75a5fb6346 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:05.367790 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ddd0c-a962-4d26-a5bc-af75a5fb6346 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:05.369265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ddd0c-a962-4d26-a5bc-af75a5fb6346 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-057ddd0c-a962-4d26-a5bc-af75a5fb6346 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:49:05.382245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:49:05.383275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:05.384318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 388/787] 10.222.0.49 () {56 vars in 1132 bytes} [Thu Jul 14 11:49:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:49:05.390559 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b53b4f-4c89-4945-8d30-ecc6fc2fa95b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:05.402888 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:05.502357 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b53b4f-4c89-4945-8d30-ecc6fc2fa95b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:05.536684 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f7a07-a8e4-4188-8a6f-8a094fb1ec39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:05.537338 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f7a07-a8e4-4188-8a6f-8a094fb1ec39 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:05.537611 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f7a07-a8e4-4188-8a6f-8a094fb1ec39 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:05.537885 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f7a07-a8e4-4188-8a6f-8a094fb1ec39 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:05.538585 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f7a07-a8e4-4188-8a6f-8a094fb1ec39 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:05.538893 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f7a07-a8e4-4188-8a6f-8a094fb1ec39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:05.540285 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f7a07-a8e4-4188-8a6f-8a094fb1ec39 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:05.545292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 400/788] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 14 11:49:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:49:05.550763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ddd0c-a962-4d26-a5bc-af75a5fb6346 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:05.579398 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:05.650010 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ddd0c-a962-4d26-a5bc-af75a5fb6346 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:05.687207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8312b-24ef-47ab-97cd-81a6e604963f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:05.687875 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8312b-24ef-47ab-97cd-81a6e604963f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:05.688186 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8312b-24ef-47ab-97cd-81a6e604963f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:05.688464 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8312b-24ef-47ab-97cd-81a6e604963f None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:05.689173 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8312b-24ef-47ab-97cd-81a6e604963f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:05.689480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8312b-24ef-47ab-97cd-81a6e604963f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:05.690838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8312b-24ef-47ab-97cd-81a6e604963f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:05.695982 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 389/789] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 14 11:49:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:49:05.701918 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f7a07-a8e4-4188-8a6f-8a094fb1ec39 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:05.771356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:05.800265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f7a07-a8e4-4188-8a6f-8a094fb1ec39 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:05.833507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd4c91-eb93-4216-8ef4-093787f02955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:05.834115 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd4c91-eb93-4216-8ef4-093787f02955 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:05.834399 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd4c91-eb93-4216-8ef4-093787f02955 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:05.834678 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd4c91-eb93-4216-8ef4-093787f02955 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:05.835416 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd4c91-eb93-4216-8ef4-093787f02955 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:05.836804 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd4c91-eb93-4216-8ef4-093787f02955 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:05.856878 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 401/790] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 14 11:49:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:49:07.589303 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e452baa-7409-4647-b39b-f143fdc225b8 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:07.589805 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e452baa-7409-4647-b39b-f143fdc225b8 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:07.589805 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e452baa-7409-4647-b39b-f143fdc225b8 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:07.591122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 390/791] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:49:07.596825 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491291b-f775-4ee9-8493-99c398d2ea4f None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:07.597223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491291b-f775-4ee9-8493-99c398d2ea4f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:07.597397 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491291b-f775-4ee9-8493-99c398d2ea4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:07.613807 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-3491291b-f775-4ee9-8493-99c398d2ea4f None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:49:07.614991 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3491291b-f775-4ee9-8493-99c398d2ea4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:49:07.685980 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 402/792] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:49:07 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:49:07.710855 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e452baa-7409-4647-b39b-f143fdc225b8 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:07.803177 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:07.814363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e452baa-7409-4647-b39b-f143fdc225b8 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:07.847534 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308c10b-829d-48da-8531-96bdd301d704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:07.848226 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308c10b-829d-48da-8531-96bdd301d704 None admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:07.848515 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308c10b-829d-48da-8531-96bdd301d704 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:07.848795 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308c10b-829d-48da-8531-96bdd301d704 None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:07.849500 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308c10b-829d-48da-8531-96bdd301d704 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:07.850927 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308c10b-829d-48da-8531-96bdd301d704 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:07.852323 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: WARNING keystone.server.flask.common [None req-0308c10b-829d-48da-8531-96bdd301d704 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 11:49:07.869245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.sql.core [None req-0308c10b-829d-48da-8531-96bdd301d704 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 11:49:07.869245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 11:49:07.869245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [parameters: {'id': '8922ddffac464ee495c4fc02db5b723d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 11:49:07.869245 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87129) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 11:49:07.887485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-0308c10b-829d-48da-8531-96bdd301d704 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8922ddffac464ee495c4fc02db5b723d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8922ddffac464ee495c4fc02db5b723d. Jul 14 11:49:07.887485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:07.887485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:49:07.887485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:49:07.887485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:49:07.887485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:49:07.887485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:49:07.887485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:49:07.887485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:49:07.887485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:49:07.887485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:49:07.887485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:49:07.887485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application result.read() Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 11:49:07.888552 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application yield resource Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise self.value Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application session.commit() Jul 14 11:49:07.894717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self.session.flush() Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application compat.raise_( Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 11:49:07.896016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 11:49:07.897110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 11:49:07.897110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 11:49:07.897110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 11:49:07.897110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 11:49:07.897110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 11:49:07.897110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 11:49:07.897110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 11:49:07.897110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 11:49:07.897110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 11:49:07.897110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 11:49:07.897110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 11:49:07.897110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 11:49:07.897110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 11:49:07.897110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 11:49:07.897110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application result.read() Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:49:07.897901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:49:07.898918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:49:07.898918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:49:07.898918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:49:07.898918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:49:07.898918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:49:07.898918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:49:07.898918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 11:49:07.898918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 11:49:07.898918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [parameters: {'id': '8922ddffac464ee495c4fc02db5b723d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 11:49:07.898918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 11:49:07.898918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:07.898918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:49:07.898918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:07.898918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:07.898918 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:49:07.899817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:49:07.900945 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:49:07.900945 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 11:49:07.900945 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 11:49:07.900945 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:49:07.900945 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:49:07.900945 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 11:49:07.900945 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 11:49:07.900945 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8922ddffac464ee495c4fc02db5b723d. Jul 14 11:49:07.900945 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:07.900945 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 391/793] 10.222.0.49 () {60 vars in 1140 bytes} [Thu Jul 14 11:49:07 2022] POST /identity/v3/projects => generated 262 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:49:07.902056 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491291b-f775-4ee9-8493-99c398d2ea4f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:07.951197 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:07.996815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491291b-f775-4ee9-8493-99c398d2ea4f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:08.033870 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302e505-e47e-40bc-87f6-44861d890474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:08.034674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302e505-e47e-40bc-87f6-44861d890474 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:08.034963 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302e505-e47e-40bc-87f6-44861d890474 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:08.035241 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302e505-e47e-40bc-87f6-44861d890474 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:08.042203 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302e505-e47e-40bc-87f6-44861d890474 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:08.044685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302e505-e47e-40bc-87f6-44861d890474 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:08.058583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-7302e505-e47e-40bc-87f6-44861d890474 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:49:08.058583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:08.058583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:49:08.058583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:49:08.058583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:49:08.058583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:49:08.058583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:49:08.058583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:49:08.058583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:49:08.058583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:49:08.058583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:49:08.058583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:49:08.058583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:49:08.058583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:49:08.058583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:49:08.059490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:49:08.060430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:49:08.060430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:49:08.060430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:49:08.060430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:49:08.060430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:49:08.060430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:49:08.060430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:49:08.060430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:08.060430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 403/794] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:49:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:49:08.065821 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308c10b-829d-48da-8531-96bdd301d704 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:08.165083 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a054b-f35c-4c18-9b83-44527d685b4f None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:08.165282 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a054b-f35c-4c18-9b83-44527d685b4f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:08.165549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a054b-f35c-4c18-9b83-44527d685b4f None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:08.166315 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308c10b-829d-48da-8531-96bdd301d704 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:08.166888 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 404/795] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:49:08.171801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce551e6-efd1-4fcf-abae-a5a921c1203a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:08.172121 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce551e6-efd1-4fcf-abae-a5a921c1203a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:08.172408 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce551e6-efd1-4fcf-abae-a5a921c1203a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:08.190015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-cce551e6-efd1-4fcf-abae-a5a921c1203a None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:49:08.191208 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-cce551e6-efd1-4fcf-abae-a5a921c1203a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:49:08.202674 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e5bd2-4340-4e67-9e5f-e9ce5c56c404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:08.203345 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e5bd2-4340-4e67-9e5f-e9ce5c56c404 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:08.203633 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e5bd2-4340-4e67-9e5f-e9ce5c56c404 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:08.203947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e5bd2-4340-4e67-9e5f-e9ce5c56c404 None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:08.204706 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e5bd2-4340-4e67-9e5f-e9ce5c56c404 None admin] RBAC: Adding query filter params (name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:08.205265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e5bd2-4340-4e67-9e5f-e9ce5c56c404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:08.206905 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e5bd2-4340-4e67-9e5f-e9ce5c56c404 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:08.227243 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 392/796] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 14 11:49:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:49:08.262025 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 405/797] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:49:08 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:49:08.287374 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e5bd2-4340-4e67-9e5f-e9ce5c56c404 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:08.296992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:08.397890 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e5bd2-4340-4e67-9e5f-e9ce5c56c404 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:08.433117 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad891f-30e2-4a7d-8ab4-c870e5c67b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:08.433876 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad891f-30e2-4a7d-8ab4-c870e5c67b86 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:08.434166 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad891f-30e2-4a7d-8ab4-c870e5c67b86 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:08.434449 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad891f-30e2-4a7d-8ab4-c870e5c67b86 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:08.435110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad891f-30e2-4a7d-8ab4-c870e5c67b86 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:08.436541 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad891f-30e2-4a7d-8ab4-c870e5c67b86 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-81ad891f-30e2-4a7d-8ab4-c870e5c67b86 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:49:08.448337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:49:08.450037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:49:08.451050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:49:08.451050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:49:08.451050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:49:08.451050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:49:08.451050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:49:08.451050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:49:08.451050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:49:08.451050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:49:08.451050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:49:08.451050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:49:08.451050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:49:08.451050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:49:08.451050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:49:08.451050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:08.455083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 393/798] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:49:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:49:08.456717 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce551e6-efd1-4fcf-abae-a5a921c1203a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:08.514945 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:08.572276 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce551e6-efd1-4fcf-abae-a5a921c1203a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:08.607220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9d7f3-592f-4748-88de-6f57287599a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:08.607872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9d7f3-592f-4748-88de-6f57287599a1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:08.608175 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9d7f3-592f-4748-88de-6f57287599a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:08.608453 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9d7f3-592f-4748-88de-6f57287599a1 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:08.609160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9d7f3-592f-4748-88de-6f57287599a1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:08.609472 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9d7f3-592f-4748-88de-6f57287599a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:08.610847 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9d7f3-592f-4748-88de-6f57287599a1 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:08.615564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 406/799] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 14 11:49:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:49:08.622359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad891f-30e2-4a7d-8ab4-c870e5c67b86 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:08.693573 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:08.728584 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad891f-30e2-4a7d-8ab4-c870e5c67b86 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:08.764921 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3a8d3-e071-4f81-8493-b81a50f2f29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:08.765588 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a8d3-e071-4f81-8493-b81a50f2f29b None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:08.765873 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a8d3-e071-4f81-8493-b81a50f2f29b None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:08.766152 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a8d3-e071-4f81-8493-b81a50f2f29b None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:08.766854 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3a8d3-e071-4f81-8493-b81a50f2f29b None admin] RBAC: Adding query filter params (type=compute) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:08.767172 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3a8d3-e071-4f81-8493-b81a50f2f29b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:08.768564 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3a8d3-e071-4f81-8493-b81a50f2f29b None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:08.773559 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 394/800] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 14 11:49:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:49:10.538143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2caaa8-7bcb-4460-8833-d42fcbf4abeb None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:10.538658 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2caaa8-7bcb-4460-8833-d42fcbf4abeb None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:10.538658 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2caaa8-7bcb-4460-8833-d42fcbf4abeb None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:10.540097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 407/801] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:49:10.545389 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0426fe-4a5e-4050-94d3-10a12b5d1b88 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:10.545813 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0426fe-4a5e-4050-94d3-10a12b5d1b88 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:10.545923 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0426fe-4a5e-4050-94d3-10a12b5d1b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:10.562644 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-bf0426fe-4a5e-4050-94d3-10a12b5d1b88 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:49:10.564165 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-bf0426fe-4a5e-4050-94d3-10a12b5d1b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:49:10.630271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 395/802] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:49:10 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:49:10.656863 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2caaa8-7bcb-4460-8833-d42fcbf4abeb None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:10.758549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2caaa8-7bcb-4460-8833-d42fcbf4abeb None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:10.768329 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:10.792843 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ba511-247b-4333-bef6-06623082fcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:10.793477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ba511-247b-4333-bef6-06623082fcd3 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:10.793872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ba511-247b-4333-bef6-06623082fcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:10.794151 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ba511-247b-4333-bef6-06623082fcd3 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:10.794845 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ba511-247b-4333-bef6-06623082fcd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:10.796314 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ba511-247b-4333-bef6-06623082fcd3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:10.797653 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: WARNING keystone.server.flask.common [None req-b68ba511-247b-4333-bef6-06623082fcd3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 11:49:10.810115 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.sql.core [None req-b68ba511-247b-4333-bef6-06623082fcd3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 11:49:10.810115 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 11:49:10.810115 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [parameters: {'user_id': 'add5fa5b858e49e39c72402b9bd1533b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 11:49:10.810115 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87130) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 11:49:10.827005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-b68ba511-247b-4333-bef6-06623082fcd3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 11:49:10.827005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:10.827005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:49:10.827005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:49:10.827005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:49:10.827005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:49:10.827005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:49:10.827005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:49:10.827005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:49:10.827005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:49:10.827005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:49:10.827005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:49:10.827005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:49:10.827005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application result.read() Jul 14 11:49:10.827005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:49:10.827868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application yield resource Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise self.value Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application session.commit() Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 11:49:10.828867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self.session.flush() Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application compat.raise_( Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 11:49:10.829746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:49:10.830620 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application result.read() Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:49:10.831737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:49:10.832588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:49:10.832588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:49:10.832588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:49:10.832588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:49:10.832588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 11:49:10.832588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 11:49:10.832588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [parameters: {'user_id': 'add5fa5b858e49e39c72402b9bd1533b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 11:49:10.832588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 11:49:10.832588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:10.832588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:49:10.832588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:10.832588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:10.832588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:49:10.832588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:49:10.832588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 11:49:10.833377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 11:49:10.834290 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 11:49:10.834290 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 11:49:10.834290 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 11:49:10.834290 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 11:49:10.834290 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 11:49:10.834290 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:10.834290 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 408/803] 10.222.0.49 () {60 vars in 1131 bytes} [Thu Jul 14 11:49:10 2022] POST /identity/v3/users => generated 160 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:49:10.834672 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0426fe-4a5e-4050-94d3-10a12b5d1b88 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:10.900996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:10.938815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0426fe-4a5e-4050-94d3-10a12b5d1b88 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:10.972510 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ef63d-6d17-4d56-b69d-0307a6cc6b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:10.973297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ef63d-6d17-4d56-b69d-0307a6cc6b69 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:10.973582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ef63d-6d17-4d56-b69d-0307a6cc6b69 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:10.973858 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ef63d-6d17-4d56-b69d-0307a6cc6b69 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:10.980795 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ef63d-6d17-4d56-b69d-0307a6cc6b69 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:10.982472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ef63d-6d17-4d56-b69d-0307a6cc6b69 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-857ef63d-6d17-4d56-b69d-0307a6cc6b69 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:49:10.997274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:49:10.998299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:49:10.999208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:49:10.999208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:49:10.999208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:49:10.999208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:49:10.999208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:49:10.999208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:49:10.999208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:49:10.999208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:49:10.999208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:49:10.999208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:10.999208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 396/804] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:49:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:49:11.004768 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ba511-247b-4333-bef6-06623082fcd3 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:11.028880 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b3c93-d1bd-435e-9893-b0c9c5de4c74 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:11.029177 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b3c93-d1bd-435e-9893-b0c9c5de4c74 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:11.029464 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b3c93-d1bd-435e-9893-b0c9c5de4c74 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:11.030838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 397/805] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:49:11.035749 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20793dd8-c278-4a37-8a7b-a8c81cfce26c None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:11.036085 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20793dd8-c278-4a37-8a7b-a8c81cfce26c None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:11.036362 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20793dd8-c278-4a37-8a7b-a8c81cfce26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:11.052696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-20793dd8-c278-4a37-8a7b-a8c81cfce26c None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:49:11.053809 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-20793dd8-c278-4a37-8a7b-a8c81cfce26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:49:11.105715 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ba511-247b-4333-bef6-06623082fcd3 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:11.120774 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 398/806] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:49:11 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:49:11.140632 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca4a49-9f31-42a4-959e-59f78dd0ac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:11.141303 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4a49-9f31-42a4-959e-59f78dd0ac89 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:11.141592 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4a49-9f31-42a4-959e-59f78dd0ac89 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:11.141875 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4a49-9f31-42a4-959e-59f78dd0ac89 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:11.142670 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca4a49-9f31-42a4-959e-59f78dd0ac89 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:11.142983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca4a49-9f31-42a4-959e-59f78dd0ac89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:11.144735 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca4a49-9f31-42a4-959e-59f78dd0ac89 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:11.144981 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20793dd8-c278-4a37-8a7b-a8c81cfce26c None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:11.182557 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 409/807] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 14 11:49:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:49:11.204031 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:11.254932 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20793dd8-c278-4a37-8a7b-a8c81cfce26c None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:11.291846 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c8b72-161a-49f0-b0b7-032bb6daee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:11.292740 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c8b72-161a-49f0-b0b7-032bb6daee18 None admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:11.293030 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c8b72-161a-49f0-b0b7-032bb6daee18 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:11.293306 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c8b72-161a-49f0-b0b7-032bb6daee18 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:11.294103 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c8b72-161a-49f0-b0b7-032bb6daee18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:11.295499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c8b72-161a-49f0-b0b7-032bb6daee18 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:11.309501 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 399/808] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 14 11:49:11 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:49:13.581739 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9660d0-0773-4fe9-b8fd-6f9450cbaf42 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:13.582253 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9660d0-0773-4fe9-b8fd-6f9450cbaf42 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:13.582253 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9660d0-0773-4fe9-b8fd-6f9450cbaf42 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:13.583831 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 410/809] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:49:13.588897 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b559a-b184-49a9-ad21-640e4fed4ffa None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:13.589265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b559a-b184-49a9-ad21-640e4fed4ffa None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:13.589459 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b559a-b184-49a9-ad21-640e4fed4ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:13.606529 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-606b559a-b184-49a9-ad21-640e4fed4ffa None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:49:13.607793 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-606b559a-b184-49a9-ad21-640e4fed4ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:49:13.678545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 400/810] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:49:13 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:49:13.702420 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9660d0-0773-4fe9-b8fd-6f9450cbaf42 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:13.730459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:13.807529 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9660d0-0773-4fe9-b8fd-6f9450cbaf42 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:13.843411 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6ea62-9dec-4437-9465-92cb84986fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:13.844172 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6ea62-9dec-4437-9465-92cb84986fc0 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:13.844461 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6ea62-9dec-4437-9465-92cb84986fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:13.844738 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6ea62-9dec-4437-9465-92cb84986fc0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:13.845384 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6ea62-9dec-4437-9465-92cb84986fc0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:13.846750 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6ea62-9dec-4437-9465-92cb84986fc0 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-77b6ea62-9dec-4437-9465-92cb84986fc0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:49:13.858783 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:49:13.859946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:49:13.860953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:49:13.860953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:49:13.860953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:49:13.860953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:49:13.860953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:49:13.860953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:49:13.860953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:49:13.860953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:49:13.860953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:49:13.860953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:49:13.860953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:49:13.860953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:49:13.860953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:49:13.860953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:49:13.860953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 411/811] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:49:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:49:13.867634 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b559a-b184-49a9-ad21-640e4fed4ffa None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:13.909097 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:13.966208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b559a-b184-49a9-ad21-640e4fed4ffa None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:14.009053 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca0277-f130-4297-8281-aef054858033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:14.010039 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca0277-f130-4297-8281-aef054858033 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:14.010470 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca0277-f130-4297-8281-aef054858033 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:14.010889 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca0277-f130-4297-8281-aef054858033 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:14.011991 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca0277-f130-4297-8281-aef054858033 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:14.012467 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca0277-f130-4297-8281-aef054858033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:14.015185 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca0277-f130-4297-8281-aef054858033 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:14.021859 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 401/812] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 14 11:49:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:49:14.028121 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6ea62-9dec-4437-9465-92cb84986fc0 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:14.119619 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:14.129654 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6ea62-9dec-4437-9465-92cb84986fc0 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:14.161665 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fbd4e-1dc4-4764-b6f7-22387bb13c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:14.162313 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fbd4e-1dc4-4764-b6f7-22387bb13c01 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:14.162599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fbd4e-1dc4-4764-b6f7-22387bb13c01 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:14.162876 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fbd4e-1dc4-4764-b6f7-22387bb13c01 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:14.163566 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fbd4e-1dc4-4764-b6f7-22387bb13c01 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:14.163882 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fbd4e-1dc4-4764-b6f7-22387bb13c01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:14.165263 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fbd4e-1dc4-4764-b6f7-22387bb13c01 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:14.170612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 412/813] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 14 11:49:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:49:14.176884 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca0277-f130-4297-8281-aef054858033 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:14.274421 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca0277-f130-4297-8281-aef054858033 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:14.276718 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:14.308273 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93e116-3c8c-44be-96f1-25b673192225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:14.308929 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93e116-3c8c-44be-96f1-25b673192225 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:14.309210 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93e116-3c8c-44be-96f1-25b673192225 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:14.309485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93e116-3c8c-44be-96f1-25b673192225 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:14.310273 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93e116-3c8c-44be-96f1-25b673192225 None admin] RBAC: Adding query filter params (interface=public, service_id=166ac22fe06f4cc9b5aa7eb9a6c7ed82, region_id=RegionOne) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:14.311334 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93e116-3c8c-44be-96f1-25b673192225 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:14.312700 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93e116-3c8c-44be-96f1-25b673192225 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:14.321020 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 402/814] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Jul 14 11:49:14 2022] GET /identity/v3/endpoints?service_id=166ac22fe06f4cc9b5aa7eb9a6c7ed82&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:49:14.326828 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fbd4e-1dc4-4764-b6f7-22387bb13c01 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:14.430193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fbd4e-1dc4-4764-b6f7-22387bb13c01 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:14.464204 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f3023-3386-42f1-a79f-87210bcc328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:14.464864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f3023-3386-42f1-a79f-87210bcc328b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:14.465152 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f3023-3386-42f1-a79f-87210bcc328b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:14.465434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f3023-3386-42f1-a79f-87210bcc328b None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:14.466106 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f3023-3386-42f1-a79f-87210bcc328b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:14.467598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f3023-3386-42f1-a79f-87210bcc328b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:14.473685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 413/815] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 14 11:49:14 2022] GET /identity/v3/services => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:49:16.693233 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d4e74-9032-4777-ac03-b7abe50fcfe2 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:16.693799 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d4e74-9032-4777-ac03-b7abe50fcfe2 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:16.693905 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d4e74-9032-4777-ac03-b7abe50fcfe2 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:16.695202 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 403/816] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:49:16.700361 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5941d2-d440-49fa-bd2f-945c2e737d7d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:16.700759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5941d2-d440-49fa-bd2f-945c2e737d7d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:16.700932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5941d2-d440-49fa-bd2f-945c2e737d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:16.717818 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-7d5941d2-d440-49fa-bd2f-945c2e737d7d None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:49:16.719467 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7d5941d2-d440-49fa-bd2f-945c2e737d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:49:16.733254 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:16.786573 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 414/817] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:49:16 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:49:16.811798 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d4e74-9032-4777-ac03-b7abe50fcfe2 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:16.912818 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d4e74-9032-4777-ac03-b7abe50fcfe2 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:16.946390 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c06ff2-6e6b-46ed-b294-3040a47e80a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:16.947108 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c06ff2-6e6b-46ed-b294-3040a47e80a9 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:16.947394 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c06ff2-6e6b-46ed-b294-3040a47e80a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:16.947673 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c06ff2-6e6b-46ed-b294-3040a47e80a9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:16.948357 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c06ff2-6e6b-46ed-b294-3040a47e80a9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:16.949717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c06ff2-6e6b-46ed-b294-3040a47e80a9 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-67c06ff2-6e6b-46ed-b294-3040a47e80a9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:49:16.961728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:49:16.962899 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:49:16.963940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:49:16.963940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:49:16.963940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:49:16.963940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:49:16.963940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:49:16.963940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:49:16.963940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:49:16.963940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:49:16.963940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:49:16.963940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:49:16.963940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:49:16.963940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:49:16.963940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:49:16.963940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:49:16.963940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 404/818] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:49:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:49:16.969441 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5941d2-d440-49fa-bd2f-945c2e737d7d None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:17.065176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5941d2-d440-49fa-bd2f-945c2e737d7d None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:17.098770 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2a008-889a-4b9c-bb87-c1a634c8655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:17.099418 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2a008-889a-4b9c-bb87-c1a634c8655b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:17.099703 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2a008-889a-4b9c-bb87-c1a634c8655b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:17.100008 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2a008-889a-4b9c-bb87-c1a634c8655b None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:17.100724 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2a008-889a-4b9c-bb87-c1a634c8655b None admin] RBAC: Adding query filter params (name=compute) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:17.101056 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2a008-889a-4b9c-bb87-c1a634c8655b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:17.102403 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2a008-889a-4b9c-bb87-c1a634c8655b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:17.106974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 415/819] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 14 11:49:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:49:17.113116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c06ff2-6e6b-46ed-b294-3040a47e80a9 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:17.144360 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:17.213123 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c06ff2-6e6b-46ed-b294-3040a47e80a9 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:17.245913 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fd9b5-a67c-40d7-8720-2af1d112d2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:17.246568 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fd9b5-a67c-40d7-8720-2af1d112d2b7 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:17.246858 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fd9b5-a67c-40d7-8720-2af1d112d2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:17.247140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fd9b5-a67c-40d7-8720-2af1d112d2b7 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:17.247839 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fd9b5-a67c-40d7-8720-2af1d112d2b7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:49:17.248180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fd9b5-a67c-40d7-8720-2af1d112d2b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:17.249645 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fd9b5-a67c-40d7-8720-2af1d112d2b7 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:17.254411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 405/820] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 14 11:49:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:49:17.260205 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2a008-889a-4b9c-bb87-c1a634c8655b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:49:17.276245 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:17.357930 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2a008-889a-4b9c-bb87-c1a634c8655b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:49:17.390608 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5ce82-a1f4-4eb1-90ab-8c5226759e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:49:17.391249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5ce82-a1f4-4eb1-90ab-8c5226759e40 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:49:17.391535 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5ce82-a1f4-4eb1-90ab-8c5226759e40 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:49:17.391814 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5ce82-a1f4-4eb1-90ab-8c5226759e40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:49:17.392568 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5ce82-a1f4-4eb1-90ab-8c5226759e40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:49:17.393931 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5ce82-a1f4-4eb1-90ab-8c5226759e40 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:49:17.412684 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 416/821] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 14 11:49:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:49:27.251956 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=52 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:27.408487 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=64,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:19.229040 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68a5fb-f6c4-43ee-83e8-b1bb15409de1 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:19.229650 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68a5fb-f6c4-43ee-83e8-b1bb15409de1 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:19.229650 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68a5fb-f6c4-43ee-83e8-b1bb15409de1 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:19.231014 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 406/822] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:50:19.238258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42723545-5d6a-4fd1-8247-cdd9a89b2542 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:19.238739 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42723545-5d6a-4fd1-8247-cdd9a89b2542 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:19.238908 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42723545-5d6a-4fd1-8247-cdd9a89b2542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:19.259788 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-42723545-5d6a-4fd1-8247-cdd9a89b2542 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:50:19.261146 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-42723545-5d6a-4fd1-8247-cdd9a89b2542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:50:19.346702 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 417/823] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:50:19 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:50:19.378923 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68a5fb-f6c4-43ee-83e8-b1bb15409de1 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:19.502599 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68a5fb-f6c4-43ee-83e8-b1bb15409de1 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:19.543367 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd07a46-debe-4d11-961c-173a91616806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:19.544279 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd07a46-debe-4d11-961c-173a91616806 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:19.544614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd07a46-debe-4d11-961c-173a91616806 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:19.544864 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd07a46-debe-4d11-961c-173a91616806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:19.559079 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd07a46-debe-4d11-961c-173a91616806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:19.560776 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd07a46-debe-4d11-961c-173a91616806 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:19.586431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-3cd07a46-debe-4d11-961c-173a91616806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:19.586431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:19.586431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:19.586431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:19.586431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:19.586431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:19.586431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:19.586431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:19.586431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:19.586431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:19.586431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:19.586431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:19.586431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:50:19.586431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:50:19.586431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:19.587614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:19.588606 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:50:19.588606 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:50:19.588606 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:19.588606 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:19.588606 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 407/824] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:19.594728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42723545-5d6a-4fd1-8247-cdd9a89b2542 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:19.721510 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42723545-5d6a-4fd1-8247-cdd9a89b2542 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:19.754698 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:19.767356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdacbb-eb40-466e-945d-d165e2bbd7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:19.768137 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdacbb-eb40-466e-945d-d165e2bbd7b4 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:19.768454 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdacbb-eb40-466e-945d-d165e2bbd7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:19.768736 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdacbb-eb40-466e-945d-d165e2bbd7b4 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:19.769655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdacbb-eb40-466e-945d-d165e2bbd7b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:19.770036 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdacbb-eb40-466e-945d-d165e2bbd7b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:19.771556 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdacbb-eb40-466e-945d-d165e2bbd7b4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:19.795637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 418/825] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:50:19.797643 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd07a46-debe-4d11-961c-173a91616806 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:19.884505 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:19.967296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd07a46-debe-4d11-961c-173a91616806 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:20.014231 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689da83-fe0c-48bb-864e-79636fe37b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:20.014989 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689da83-fe0c-48bb-864e-79636fe37b46 None admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:20.016293 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689da83-fe0c-48bb-864e-79636fe37b46 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:20.016600 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689da83-fe0c-48bb-864e-79636fe37b46 None admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:20.017321 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689da83-fe0c-48bb-864e-79636fe37b46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:20.018774 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689da83-fe0c-48bb-864e-79636fe37b46 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:20.042375 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 408/826] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 14 11:50:19 2022] POST /identity/v3/users => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:50:22.652725 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71824675-5a97-44f3-8ce3-f0a451891441 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:22.653278 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71824675-5a97-44f3-8ce3-f0a451891441 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:22.653278 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71824675-5a97-44f3-8ce3-f0a451891441 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:22.654662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 419/827] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:50:22.661403 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf08de-3ba8-41ed-873d-6979b0e41afa None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:22.661919 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf08de-3ba8-41ed-873d-6979b0e41afa None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:22.662017 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf08de-3ba8-41ed-873d-6979b0e41afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:22.681897 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-e0bf08de-3ba8-41ed-873d-6979b0e41afa None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:50:22.683800 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-e0bf08de-3ba8-41ed-873d-6979b0e41afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:50:22.779942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 409/828] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:50:22 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:50:22.809777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71824675-5a97-44f3-8ce3-f0a451891441 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:22.949844 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71824675-5a97-44f3-8ce3-f0a451891441 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:22.989179 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7f95c-c605-406c-8676-f5bd5223c819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:22.990473 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7f95c-c605-406c-8676-f5bd5223c819 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:22.990952 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7f95c-c605-406c-8676-f5bd5223c819 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:22.991415 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7f95c-c605-406c-8676-f5bd5223c819 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:23.004512 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7f95c-c605-406c-8676-f5bd5223c819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-69a7f95c-c605-406c-8676-f5bd5223c819 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:50:23.013097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:23.015762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:23.017612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:23.017612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:23.017612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:23.017612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:23.017612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:50:23.017612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:50:23.017612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:50:23.017612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:50:23.017612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:50:23.017612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:50:23.017612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:50:23.017612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:23.017612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 420/829] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:50:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:50:23.024532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf08de-3ba8-41ed-873d-6979b0e41afa None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:23.071806 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:23.143271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf08de-3ba8-41ed-873d-6979b0e41afa None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:23.190481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b80b17-1a0b-419a-9139-081ad2db4141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:23.191196 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b80b17-1a0b-419a-9139-081ad2db4141 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:23.191451 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b80b17-1a0b-419a-9139-081ad2db4141 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:23.191722 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b80b17-1a0b-419a-9139-081ad2db4141 None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:23.192490 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b80b17-1a0b-419a-9139-081ad2db4141 None admin] RBAC: Adding query filter params (name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:23.192811 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b80b17-1a0b-419a-9139-081ad2db4141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:23.195195 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b80b17-1a0b-419a-9139-081ad2db4141 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:23.206481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 410/830] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 14 11:50:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:23.212602 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7f95c-c605-406c-8676-f5bd5223c819 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:23.263640 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:23.328002 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7f95c-c605-406c-8676-f5bd5223c819 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:23.365702 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797659eb-8cd0-4505-ba47-86c7d6b0c318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:23.366848 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797659eb-8cd0-4505-ba47-86c7d6b0c318 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:23.367209 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797659eb-8cd0-4505-ba47-86c7d6b0c318 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:23.367598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797659eb-8cd0-4505-ba47-86c7d6b0c318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:23.382094 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797659eb-8cd0-4505-ba47-86c7d6b0c318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:23.383871 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797659eb-8cd0-4505-ba47-86c7d6b0c318 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:23.404422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-797659eb-8cd0-4505-ba47-86c7d6b0c318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:23.404422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:23.404422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:23.404422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:23.404422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:23.404422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:23.404422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:23.404422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:23.404422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:23.404422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:23.404422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:23.404422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:23.404422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:50:23.404422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:50:23.404422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:23.406534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:23.407413 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:50:23.407413 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:50:23.407413 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:23.407413 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:23.407413 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 421/831] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:23.412482 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b80b17-1a0b-419a-9139-081ad2db4141 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:23.530796 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:23.536098 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b80b17-1a0b-419a-9139-081ad2db4141 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:23.576440 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb63cf-c58c-4fc0-8d61-d818b6d73ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:23.577112 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb63cf-c58c-4fc0-8d61-d818b6d73ce8 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:23.577399 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb63cf-c58c-4fc0-8d61-d818b6d73ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:23.577679 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb63cf-c58c-4fc0-8d61-d818b6d73ce8 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:23.578993 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb63cf-c58c-4fc0-8d61-d818b6d73ce8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:23.579312 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb63cf-c58c-4fc0-8d61-d818b6d73ce8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:23.581034 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb63cf-c58c-4fc0-8d61-d818b6d73ce8 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:23.597368 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 411/832] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:23.604498 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797659eb-8cd0-4505-ba47-86c7d6b0c318 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:23.722449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:23.726577 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797659eb-8cd0-4505-ba47-86c7d6b0c318 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:23.763483 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952786d-ce9a-435f-bd64-ddb1a3a63c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:23.764320 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952786d-ce9a-435f-bd64-ddb1a3a63c85 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:23.764603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952786d-ce9a-435f-bd64-ddb1a3a63c85 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:23.764880 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952786d-ce9a-435f-bd64-ddb1a3a63c85 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:23.773208 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952786d-ce9a-435f-bd64-ddb1a3a63c85 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:23.778844 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952786d-ce9a-435f-bd64-ddb1a3a63c85 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-6952786d-ce9a-435f-bd64-ddb1a3a63c85 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:50:23.794940 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:23.796144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:23.798382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:23.798382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:23.798382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:50:23.798382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:50:23.798382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:50:23.798382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:50:23.798382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:50:23.798382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:50:23.798382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:50:23.798382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:23.798382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 422/833] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:23.802683 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb63cf-c58c-4fc0-8d61-d818b6d73ce8 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:23.915379 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb63cf-c58c-4fc0-8d61-d818b6d73ce8 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:23.956507 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e222cb4-b6a4-478e-a1b3-addb095a932f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:23.957211 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e222cb4-b6a4-478e-a1b3-addb095a932f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:23.957723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e222cb4-b6a4-478e-a1b3-addb095a932f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:23.958037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e222cb4-b6a4-478e-a1b3-addb095a932f None admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:23.959163 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e222cb4-b6a4-478e-a1b3-addb095a932f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:23.959720 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e222cb4-b6a4-478e-a1b3-addb095a932f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:23.961517 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e222cb4-b6a4-478e-a1b3-addb095a932f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:23.982890 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 412/834] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Jul 14 11:50:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:50:23.989253 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952786d-ce9a-435f-bd64-ddb1a3a63c85 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:24.104596 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952786d-ce9a-435f-bd64-ddb1a3a63c85 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:24.140065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a506d-7c71-47b8-8aaf-12f0c739d13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:24.141338 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a506d-7c71-47b8-8aaf-12f0c739d13b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:24.141741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a506d-7c71-47b8-8aaf-12f0c739d13b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:24.142075 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a506d-7c71-47b8-8aaf-12f0c739d13b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:24.171592 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:24.230746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a506d-7c71-47b8-8aaf-12f0c739d13b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:24.233401 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a506d-7c71-47b8-8aaf-12f0c739d13b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:24.352660 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 423/835] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:50:23 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:50:24.358548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e222cb4-b6a4-478e-a1b3-addb095a932f None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:24.382420 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:24.477864 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e222cb4-b6a4-478e-a1b3-addb095a932f None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:24.515274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50708331-b73e-4fac-b991-010256c7ea04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:24.516592 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50708331-b73e-4fac-b991-010256c7ea04 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:24.516871 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50708331-b73e-4fac-b991-010256c7ea04 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:24.517147 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50708331-b73e-4fac-b991-010256c7ea04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:24.527063 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50708331-b73e-4fac-b991-010256c7ea04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:24.528539 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50708331-b73e-4fac-b991-010256c7ea04 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:24.545843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-50708331-b73e-4fac-b991-010256c7ea04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:24.545843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:24.545843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:24.545843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:24.545843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:24.545843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:24.545843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:24.545843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:24.545843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:24.545843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:24.545843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:24.545843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:24.545843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:50:24.545843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:50:24.545843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:24.546990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:24.548074 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:50:24.548074 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:50:24.548074 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:24.548074 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:24.548074 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 413/836] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:24.553259 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a506d-7c71-47b8-8aaf-12f0c739d13b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:24.627830 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:24.672818 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a506d-7c71-47b8-8aaf-12f0c739d13b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:24.712844 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8baa5-9f95-45c4-a79a-4afc8b4f2c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:24.713666 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8baa5-9f95-45c4-a79a-4afc8b4f2c8d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:24.713999 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8baa5-9f95-45c4-a79a-4afc8b4f2c8d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:24.714302 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8baa5-9f95-45c4-a79a-4afc8b4f2c8d None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:24.715202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8baa5-9f95-45c4-a79a-4afc8b4f2c8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:24.715577 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8baa5-9f95-45c4-a79a-4afc8b4f2c8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:24.717244 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8baa5-9f95-45c4-a79a-4afc8b4f2c8d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:24.730373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 424/837] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:24.737141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50708331-b73e-4fac-b991-010256c7ea04 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:24.825408 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:24.863700 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50708331-b73e-4fac-b991-010256c7ea04 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:24.911215 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebf1d2-a3a4-4846-912f-0ad6d87c1b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:24.912247 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebf1d2-a3a4-4846-912f-0ad6d87c1b73 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:24.912585 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebf1d2-a3a4-4846-912f-0ad6d87c1b73 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:24.912871 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebf1d2-a3a4-4846-912f-0ad6d87c1b73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:24.920331 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebf1d2-a3a4-4846-912f-0ad6d87c1b73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:24.921768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebf1d2-a3a4-4846-912f-0ad6d87c1b73 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:24.946758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-c2ebf1d2-a3a4-4846-912f-0ad6d87c1b73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:50:24.946758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:24.946758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:24.946758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:24.946758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:24.946758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:24.946758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:24.946758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:24.946758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:24.946758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:24.946758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:24.946758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:24.946758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:50:24.946758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:50:24.946758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:24.947824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:24.948773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:50:24.948773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:50:24.948773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:50:24.948773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:50:24.948773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:50:24.948773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:50:24.948773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:50:24.948773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:24.948773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 414/838] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:50:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:24.954663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8baa5-9f95-45c4-a79a-4afc8b4f2c8d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:25.080097 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8baa5-9f95-45c4-a79a-4afc8b4f2c8d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:25.099704 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:25.121189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00cef9-12dc-4d3b-97cc-4abe5745ab65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:25.121872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00cef9-12dc-4d3b-97cc-4abe5745ab65 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:25.122148 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00cef9-12dc-4d3b-97cc-4abe5745ab65 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:25.122433 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00cef9-12dc-4d3b-97cc-4abe5745ab65 None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:25.123339 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00cef9-12dc-4d3b-97cc-4abe5745ab65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:25.123670 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00cef9-12dc-4d3b-97cc-4abe5745ab65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:25.125826 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00cef9-12dc-4d3b-97cc-4abe5745ab65 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:25.139368 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 425/839] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:50:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:25.146282 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebf1d2-a3a4-4846-912f-0ad6d87c1b73 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:25.268139 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebf1d2-a3a4-4846-912f-0ad6d87c1b73 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:25.301549 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:25.307741 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030915b8-e8a8-4671-9e10-f9c8caac743e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:25.308496 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030915b8-e8a8-4671-9e10-f9c8caac743e None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:25.308786 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030915b8-e8a8-4671-9e10-f9c8caac743e None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:25.309072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030915b8-e8a8-4671-9e10-f9c8caac743e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:25.309948 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030915b8-e8a8-4671-9e10-f9c8caac743e None admin] RBAC: Adding query filter params (role.id=7ae76d85b6364363960c2e6fc20bc78a, scope.project.id=b711bbd57a5446a39ee7c2cf96356083, user.id=de477915cf5e41e8a65a57e8b546997f) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:25.310265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030915b8-e8a8-4671-9e10-f9c8caac743e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:25.311694 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030915b8-e8a8-4671-9e10-f9c8caac743e None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:25.317950 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 415/840] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:50:25 2022] GET /identity/v3/role_assignments?user.id=de477915cf5e41e8a65a57e8b546997f&scope.project.id=b711bbd57a5446a39ee7c2cf96356083&role.id=7ae76d85b6364363960c2e6fc20bc78a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:50:27.791427 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b864b1-da6e-48cb-882e-2b1d7ea46132 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:27.792014 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b864b1-da6e-48cb-882e-2b1d7ea46132 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:27.792014 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b864b1-da6e-48cb-882e-2b1d7ea46132 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:27.793417 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 426/841] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:50:27.799358 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b98ae-6b6e-4d6b-b103-c1515f1d1180 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:27.800032 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b98ae-6b6e-4d6b-b103-c1515f1d1180 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:27.800032 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b98ae-6b6e-4d6b-b103-c1515f1d1180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:27.818824 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-456b98ae-6b6e-4d6b-b103-c1515f1d1180 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:50:27.820393 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-456b98ae-6b6e-4d6b-b103-c1515f1d1180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:50:27.894420 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 416/842] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:50:27 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:50:27.919527 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b864b1-da6e-48cb-882e-2b1d7ea46132 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:28.042513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b864b1-da6e-48cb-882e-2b1d7ea46132 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:28.080013 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6bf33-786a-48ed-9c18-ca9126e4cbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:28.080822 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6bf33-786a-48ed-9c18-ca9126e4cbd1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:28.081114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6bf33-786a-48ed-9c18-ca9126e4cbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:28.081396 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6bf33-786a-48ed-9c18-ca9126e4cbd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:28.092585 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6bf33-786a-48ed-9c18-ca9126e4cbd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-b1e6bf33-786a-48ed-9c18-ca9126e4cbd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:50:28.102099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:28.103265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:28.104523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:28.104523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:28.104523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:28.104523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:28.104523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:50:28.104523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:50:28.104523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:50:28.104523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:50:28.104523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:50:28.104523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:50:28.104523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:50:28.104523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:28.104523 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 427/843] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:50:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:28.110438 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b98ae-6b6e-4d6b-b103-c1515f1d1180 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:28.220928 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b98ae-6b6e-4d6b-b103-c1515f1d1180 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:28.246930 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:28.259138 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f7550-84cc-4049-a86f-14c61c5f657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:28.259792 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f7550-84cc-4049-a86f-14c61c5f657d None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:28.260115 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f7550-84cc-4049-a86f-14c61c5f657d None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:28.260395 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f7550-84cc-4049-a86f-14c61c5f657d None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:28.261153 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f7550-84cc-4049-a86f-14c61c5f657d None admin] RBAC: Adding query filter params (name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:28.261448 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f7550-84cc-4049-a86f-14c61c5f657d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:28.262815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f7550-84cc-4049-a86f-14c61c5f657d None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:28.272696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 417/844] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 14 11:50:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:28.278761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6bf33-786a-48ed-9c18-ca9126e4cbd1 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:28.324205 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:28.393050 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6bf33-786a-48ed-9c18-ca9126e4cbd1 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:28.431861 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8468cf-62f0-411a-a743-f4f6c5d3649b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:28.432694 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8468cf-62f0-411a-a743-f4f6c5d3649b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:28.432979 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8468cf-62f0-411a-a743-f4f6c5d3649b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:28.433258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8468cf-62f0-411a-a743-f4f6c5d3649b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:28.443524 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8468cf-62f0-411a-a743-f4f6c5d3649b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:28.445028 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8468cf-62f0-411a-a743-f4f6c5d3649b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:28.471176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-8e8468cf-62f0-411a-a743-f4f6c5d3649b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:28.471176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:28.471176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:28.471176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:28.471176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:28.471176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:28.471176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:28.471176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:28.471176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:28.471176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:28.471176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:28.471176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:28.471176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:50:28.471176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:50:28.471176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:28.473139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:28.474254 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:50:28.474254 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:50:28.474254 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:28.474254 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:28.474254 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 428/845] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:28.479628 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f7550-84cc-4049-a86f-14c61c5f657d None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:28.598083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f7550-84cc-4049-a86f-14c61c5f657d None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:28.640652 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f97ab5-ee30-4473-9934-4d33790da4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:28.641567 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f97ab5-ee30-4473-9934-4d33790da4cb None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:28.641838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f97ab5-ee30-4473-9934-4d33790da4cb None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:28.642144 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f97ab5-ee30-4473-9934-4d33790da4cb None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:28.642914 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f97ab5-ee30-4473-9934-4d33790da4cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:28.643264 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f97ab5-ee30-4473-9934-4d33790da4cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:28.645131 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f97ab5-ee30-4473-9934-4d33790da4cb None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:28.661491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 418/846] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:28.669002 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8468cf-62f0-411a-a743-f4f6c5d3649b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:28.793054 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:28.805830 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8468cf-62f0-411a-a743-f4f6c5d3649b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:28.840948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc4e9d-d890-4abc-8238-a92542142c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:28.841750 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc4e9d-d890-4abc-8238-a92542142c0a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:28.842037 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc4e9d-d890-4abc-8238-a92542142c0a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:28.842322 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc4e9d-d890-4abc-8238-a92542142c0a None admin] PATH_INFO: `/v3/users/placement` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:28.849925 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc4e9d-d890-4abc-8238-a92542142c0a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:28.851910 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc4e9d-d890-4abc-8238-a92542142c0a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-72cc4e9d-d890-4abc-8238-a92542142c0a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:50:28.869160 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:28.870351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:28.871476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:28.871476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:28.871476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:50:28.871476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:50:28.871476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:50:28.871476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:50:28.871476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:50:28.871476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:50:28.871476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:50:28.871476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:28.871476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 429/847] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:28.877141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f97ab5-ee30-4473-9934-4d33790da4cb None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:28.936152 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:28.998040 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f97ab5-ee30-4473-9934-4d33790da4cb None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:29.038170 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a80617-e4ab-49b9-b63a-29968b8f5bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:29.039128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a80617-e4ab-49b9-b63a-29968b8f5bc7 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:29.040743 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a80617-e4ab-49b9-b63a-29968b8f5bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:29.041066 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a80617-e4ab-49b9-b63a-29968b8f5bc7 None admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:29.042144 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a80617-e4ab-49b9-b63a-29968b8f5bc7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:29.042482 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a80617-e4ab-49b9-b63a-29968b8f5bc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:29.045411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a80617-e4ab-49b9-b63a-29968b8f5bc7 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:29.072566 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 419/848] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Jul 14 11:50:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:29.074221 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc4e9d-d890-4abc-8238-a92542142c0a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:29.201798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc4e9d-d890-4abc-8238-a92542142c0a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:29.243538 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dac7e7-95e3-4387-8f4b-5477c477f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:29.244425 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dac7e7-95e3-4387-8f4b-5477c477f57a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:29.244716 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dac7e7-95e3-4387-8f4b-5477c477f57a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:29.244997 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dac7e7-95e3-4387-8f4b-5477c477f57a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:29.256393 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dac7e7-95e3-4387-8f4b-5477c477f57a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:29.257849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dac7e7-95e3-4387-8f4b-5477c477f57a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:29.276752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-20dac7e7-95e3-4387-8f4b-5477c477f57a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:29.276752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:29.276752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:29.276752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:29.276752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:29.276752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:29.276752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:29.276752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:29.276752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:29.276752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:29.276752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:29.276752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:29.276752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:50:29.276752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:50:29.276752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:29.278356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:29.280255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:50:29.280255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:50:29.280255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:29.280255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:29.280255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 430/849] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:29.284775 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a80617-e4ab-49b9-b63a-29968b8f5bc7 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:29.405975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a80617-e4ab-49b9-b63a-29968b8f5bc7 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:29.409418 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:29.452625 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed37f-4ebf-480a-838a-1b20fade5cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:29.453229 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed37f-4ebf-480a-838a-1b20fade5cc0 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:29.454140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed37f-4ebf-480a-838a-1b20fade5cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:29.454740 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed37f-4ebf-480a-838a-1b20fade5cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:29.455792 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ed37f-4ebf-480a-838a-1b20fade5cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:29.456136 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ed37f-4ebf-480a-838a-1b20fade5cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:29.457515 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ed37f-4ebf-480a-838a-1b20fade5cc0 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:29.471928 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 420/850] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:29.478111 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dac7e7-95e3-4387-8f4b-5477c477f57a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:29.481757 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:29.589609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dac7e7-95e3-4387-8f4b-5477c477f57a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:29.631866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1a640-e249-49b0-8930-4528e994b3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:29.632726 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1a640-e249-49b0-8930-4528e994b3e8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:29.633021 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1a640-e249-49b0-8930-4528e994b3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:29.633339 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1a640-e249-49b0-8930-4528e994b3e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:29.640350 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1a640-e249-49b0-8930-4528e994b3e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:29.643016 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1a640-e249-49b0-8930-4528e994b3e8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:29.657860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-56e1a640-e249-49b0-8930-4528e994b3e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:50:29.657860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:29.657860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:29.657860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:29.657860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:29.657860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:29.657860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:29.657860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:29.657860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:29.657860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:29.657860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:29.657860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:29.657860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:50:29.657860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:50:29.657860 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:29.658821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:29.659705 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:50:29.659705 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:50:29.659705 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:50:29.659705 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:50:29.659705 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:50:29.659705 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:50:29.659705 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:50:29.659705 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:29.659705 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 431/851] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:50:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:29.665065 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed37f-4ebf-480a-838a-1b20fade5cc0 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:29.782644 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed37f-4ebf-480a-838a-1b20fade5cc0 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:29.826124 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4feb4-3f3b-4d1c-9992-6e12c1908752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:29.827310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4feb4-3f3b-4d1c-9992-6e12c1908752 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:29.827589 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4feb4-3f3b-4d1c-9992-6e12c1908752 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:29.828066 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4feb4-3f3b-4d1c-9992-6e12c1908752 None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:29.829778 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4feb4-3f3b-4d1c-9992-6e12c1908752 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:29.830176 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4feb4-3f3b-4d1c-9992-6e12c1908752 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:29.832007 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4feb4-3f3b-4d1c-9992-6e12c1908752 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:29.848569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 421/852] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:50:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:29.855233 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1a640-e249-49b0-8930-4528e994b3e8 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:29.931273 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:29.979906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1a640-e249-49b0-8930-4528e994b3e8 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:30.023488 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5c8f1-372b-4f75-900a-20af53d036ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:30.025119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5c8f1-372b-4f75-900a-20af53d036ae None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:30.025475 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5c8f1-372b-4f75-900a-20af53d036ae None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:30.025833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5c8f1-372b-4f75-900a-20af53d036ae None admin] PATH_INFO: `/v3/projects/b711bbd57a5446a39ee7c2cf96356083/users/de477915cf5e41e8a65a57e8b546997f/roles/7ae76d85b6364363960c2e6fc20bc78a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:30.042030 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5c8f1-372b-4f75-900a-20af53d036ae None admin] RBAC: Authorizing `identity:create_grant(project_id=b711bbd57a5446a39ee7c2cf96356083, user_id=de477915cf5e41e8a65a57e8b546997f, role_id=7ae76d85b6364363960c2e6fc20bc78a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:30.043527 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5c8f1-372b-4f75-900a-20af53d036ae None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:30.057275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 432/853] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:50:29 2022] PUT /identity/v3/projects/b711bbd57a5446a39ee7c2cf96356083/users/de477915cf5e41e8a65a57e8b546997f/roles/7ae76d85b6364363960c2e6fc20bc78a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:50:32.476701 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974d946-cd7d-49e7-86ef-43f19d9624f3 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:32.477639 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974d946-cd7d-49e7-86ef-43f19d9624f3 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:32.477639 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974d946-cd7d-49e7-86ef-43f19d9624f3 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:32.478882 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 422/854] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:50:32.484768 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3891b7f-7f9c-4de9-96a0-1c2c9c99138d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:32.485743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3891b7f-7f9c-4de9-96a0-1c2c9c99138d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:32.485973 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3891b7f-7f9c-4de9-96a0-1c2c9c99138d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:32.505215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c3891b7f-7f9c-4de9-96a0-1c2c9c99138d None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:50:32.507105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c3891b7f-7f9c-4de9-96a0-1c2c9c99138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:50:32.582231 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 433/855] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:50:32 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:50:32.609038 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974d946-cd7d-49e7-86ef-43f19d9624f3 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:32.638980 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:32.733081 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974d946-cd7d-49e7-86ef-43f19d9624f3 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:32.771660 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d961b1-01c4-453e-96a9-f241e062fb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:32.772476 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d961b1-01c4-453e-96a9-f241e062fb46 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:32.772765 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d961b1-01c4-453e-96a9-f241e062fb46 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:32.773048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d961b1-01c4-453e-96a9-f241e062fb46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:32.787668 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d961b1-01c4-453e-96a9-f241e062fb46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-b5d961b1-01c4-453e-96a9-f241e062fb46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:50:32.799140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:32.800296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:32.801225 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:32.801225 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:32.801225 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:32.801225 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:32.801225 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:50:32.801225 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:50:32.801225 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:50:32.801225 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:50:32.801225 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:50:32.801225 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:50:32.801225 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:50:32.801225 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:32.801977 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 423/856] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 14 11:50:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:50:32.808252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3891b7f-7f9c-4de9-96a0-1c2c9c99138d None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:32.856368 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:32.919761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3891b7f-7f9c-4de9-96a0-1c2c9c99138d None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:32.961608 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e378c-53c2-48f6-96b9-f5c545ffa8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:32.962288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e378c-53c2-48f6-96b9-f5c545ffa8ae None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:32.962575 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e378c-53c2-48f6-96b9-f5c545ffa8ae None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:32.962861 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e378c-53c2-48f6-96b9-f5c545ffa8ae None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:32.963605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e378c-53c2-48f6-96b9-f5c545ffa8ae None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:32.963950 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e378c-53c2-48f6-96b9-f5c545ffa8ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:32.965332 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e378c-53c2-48f6-96b9-f5c545ffa8ae None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:32.975853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 434/857] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 14 11:50:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:32.982046 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d961b1-01c4-453e-96a9-f241e062fb46 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:33.082183 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:33.101993 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d961b1-01c4-453e-96a9-f241e062fb46 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:33.146629 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f897a0-539f-484d-8a13-5fda0fe1c8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:33.147496 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f897a0-539f-484d-8a13-5fda0fe1c8e0 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:33.147790 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f897a0-539f-484d-8a13-5fda0fe1c8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:33.148254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f897a0-539f-484d-8a13-5fda0fe1c8e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:33.161963 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f897a0-539f-484d-8a13-5fda0fe1c8e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:33.163432 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f897a0-539f-484d-8a13-5fda0fe1c8e0 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:33.182004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-26f897a0-539f-484d-8a13-5fda0fe1c8e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:33.182004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:33.182004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:33.182004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:33.182004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:33.182004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:33.182004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:33.182004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:33.182004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:33.182004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:33.182004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:33.182004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:33.182004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:50:33.182004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:50:33.182004 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:33.183047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:33.184093 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:50:33.184093 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:50:33.184093 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:33.184093 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:33.184093 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 424/858] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:33.190424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e378c-53c2-48f6-96b9-f5c545ffa8ae None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:33.302778 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e378c-53c2-48f6-96b9-f5c545ffa8ae None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:33.305170 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:33.338104 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a0a7a-b767-4d51-913a-e8623b4fbaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:33.338802 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a0a7a-b767-4d51-913a-e8623b4fbaf9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:33.339341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a0a7a-b767-4d51-913a-e8623b4fbaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:33.339761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a0a7a-b767-4d51-913a-e8623b4fbaf9 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:33.340727 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a0a7a-b767-4d51-913a-e8623b4fbaf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:33.341156 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a0a7a-b767-4d51-913a-e8623b4fbaf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:33.342842 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a0a7a-b767-4d51-913a-e8623b4fbaf9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:33.359130 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 435/859] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:33.367018 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f897a0-539f-484d-8a13-5fda0fe1c8e0 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:33.484834 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f897a0-539f-484d-8a13-5fda0fe1c8e0 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:33.519938 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18394e9a-575b-4cbe-a729-50cf9adc6011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:33.520734 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18394e9a-575b-4cbe-a729-50cf9adc6011 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:33.521018 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18394e9a-575b-4cbe-a729-50cf9adc6011 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:33.521292 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18394e9a-575b-4cbe-a729-50cf9adc6011 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:33.524111 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:33.529602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18394e9a-575b-4cbe-a729-50cf9adc6011 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:33.531045 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18394e9a-575b-4cbe-a729-50cf9adc6011 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-18394e9a-575b-4cbe-a729-50cf9adc6011 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:50:33.546110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:33.547291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:33.549116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:33.549116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:33.549116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:50:33.549116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:50:33.549116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:50:33.549116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:50:33.549116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:50:33.549116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:50:33.549116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:50:33.549116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:33.549116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 425/860] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:33.554000 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a0a7a-b767-4d51-913a-e8623b4fbaf9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:33.678453 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a0a7a-b767-4d51-913a-e8623b4fbaf9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:33.715820 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe30c5d-b316-4070-b4c3-723d558b97ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:33.716522 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe30c5d-b316-4070-b4c3-723d558b97ce None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:33.716811 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe30c5d-b316-4070-b4c3-723d558b97ce None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:33.717093 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe30c5d-b316-4070-b4c3-723d558b97ce None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:33.717921 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe30c5d-b316-4070-b4c3-723d558b97ce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:33.718233 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe30c5d-b316-4070-b4c3-723d558b97ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:33.720467 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe30c5d-b316-4070-b4c3-723d558b97ce None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:33.740824 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 436/861] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Jul 14 11:50:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:33.748952 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18394e9a-575b-4cbe-a729-50cf9adc6011 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:33.892326 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18394e9a-575b-4cbe-a729-50cf9adc6011 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:33.929673 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae3ef6-0b58-41e3-a44b-742c7cc2fcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:33.930275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae3ef6-0b58-41e3-a44b-742c7cc2fcff None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:33.930559 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae3ef6-0b58-41e3-a44b-742c7cc2fcff None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:33.930840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae3ef6-0b58-41e3-a44b-742c7cc2fcff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:34.005878 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:34.013102 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae3ef6-0b58-41e3-a44b-742c7cc2fcff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:34.014568 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae3ef6-0b58-41e3-a44b-742c7cc2fcff None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:34.126818 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 426/862] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:50:33 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:50:34.133332 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe30c5d-b316-4070-b4c3-723d558b97ce None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:34.160943 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:34.251883 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe30c5d-b316-4070-b4c3-723d558b97ce None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:34.289192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4d26c-b323-467b-acc4-a733ec1abad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:34.290254 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4d26c-b323-467b-acc4-a733ec1abad3 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:34.290714 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4d26c-b323-467b-acc4-a733ec1abad3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:34.291155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4d26c-b323-467b-acc4-a733ec1abad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:34.301976 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4d26c-b323-467b-acc4-a733ec1abad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:34.303434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4d26c-b323-467b-acc4-a733ec1abad3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:34.323223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-41d4d26c-b323-467b-acc4-a733ec1abad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:34.323223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:34.323223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:34.323223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:34.323223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:34.323223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:34.323223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:34.323223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:34.323223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:34.323223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:34.323223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:34.323223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:34.323223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:50:34.323223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:50:34.323223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:34.324275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:34.325240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:50:34.325240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:50:34.325240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:34.325240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:34.334001 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 437/863] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:34.334163 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae3ef6-0b58-41e3-a44b-742c7cc2fcff None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:34.441573 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:34.448044 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae3ef6-0b58-41e3-a44b-742c7cc2fcff None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:34.488510 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62741976-060f-4bb4-996f-80f7e881b805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:34.489205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62741976-060f-4bb4-996f-80f7e881b805 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:34.489452 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62741976-060f-4bb4-996f-80f7e881b805 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:34.489732 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62741976-060f-4bb4-996f-80f7e881b805 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:34.490473 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62741976-060f-4bb4-996f-80f7e881b805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:34.490787 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62741976-060f-4bb4-996f-80f7e881b805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:34.492203 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62741976-060f-4bb4-996f-80f7e881b805 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:34.506205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 427/864] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:34.512520 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4d26c-b323-467b-acc4-a733ec1abad3 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:34.599642 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:34.628569 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4d26c-b323-467b-acc4-a733ec1abad3 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:34.668288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6050c3b-bfa1-434c-b938-2924438dbe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:34.669235 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6050c3b-bfa1-434c-b938-2924438dbe71 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:34.669652 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6050c3b-bfa1-434c-b938-2924438dbe71 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:34.669959 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6050c3b-bfa1-434c-b938-2924438dbe71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:34.678168 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6050c3b-bfa1-434c-b938-2924438dbe71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:34.680112 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6050c3b-bfa1-434c-b938-2924438dbe71 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:34.696071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-f6050c3b-bfa1-434c-b938-2924438dbe71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:50:34.696071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:34.696071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:34.696071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:34.696071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:34.696071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:34.696071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:34.696071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:34.696071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:34.696071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:34.696071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:34.696071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:34.696071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:50:34.696071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:50:34.696071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:34.698528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:34.701155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:50:34.701155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:50:34.701155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:50:34.701155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:50:34.701155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:50:34.701155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:50:34.701155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:50:34.701155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:34.701155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 438/865] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:50:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:34.703871 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62741976-060f-4bb4-996f-80f7e881b805 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:34.842350 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62741976-060f-4bb4-996f-80f7e881b805 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:34.879850 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c690f0-f703-491e-b070-fc12d3108a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:34.880619 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c690f0-f703-491e-b070-fc12d3108a17 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:34.880928 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c690f0-f703-491e-b070-fc12d3108a17 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:34.881205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c690f0-f703-491e-b070-fc12d3108a17 None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:34.882163 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c690f0-f703-491e-b070-fc12d3108a17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:34.882482 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c690f0-f703-491e-b070-fc12d3108a17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:34.883998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c690f0-f703-491e-b070-fc12d3108a17 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:34.898075 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 428/866] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:50:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:50:34.904789 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6050c3b-bfa1-434c-b938-2924438dbe71 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:35.034419 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6050c3b-bfa1-434c-b938-2924438dbe71 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:35.070971 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1e993-ba4b-4980-935c-2094dede3b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:35.071633 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1e993-ba4b-4980-935c-2094dede3b14 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:35.071953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1e993-ba4b-4980-935c-2094dede3b14 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:35.072244 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1e993-ba4b-4980-935c-2094dede3b14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:35.073530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1e993-ba4b-4980-935c-2094dede3b14 None admin] RBAC: Adding query filter params (role.id=7ae76d85b6364363960c2e6fc20bc78a, scope.project.id=b711bbd57a5446a39ee7c2cf96356083, user.id=de477915cf5e41e8a65a57e8b546997f) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:35.073869 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1e993-ba4b-4980-935c-2094dede3b14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:35.075297 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1e993-ba4b-4980-935c-2094dede3b14 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:35.077240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:35.096179 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 439/867] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:50:34 2022] GET /identity/v3/role_assignments?user.id=de477915cf5e41e8a65a57e8b546997f&scope.project.id=b711bbd57a5446a39ee7c2cf96356083&role.id=7ae76d85b6364363960c2e6fc20bc78a => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:37.532626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e21dd-3f27-4d3c-a382-bec9cecdf910 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:37.533124 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e21dd-3f27-4d3c-a382-bec9cecdf910 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:37.533124 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e21dd-3f27-4d3c-a382-bec9cecdf910 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:37.534672 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 429/868] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:50:37.542525 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2fb93-83d7-4f74-857e-bbaae1f23d30 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:37.542525 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2fb93-83d7-4f74-857e-bbaae1f23d30 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:37.542525 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2fb93-83d7-4f74-857e-bbaae1f23d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:37.559982 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e1c2fb93-83d7-4f74-857e-bbaae1f23d30 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:50:37.561808 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e1c2fb93-83d7-4f74-857e-bbaae1f23d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:50:37.637867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 440/869] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:50:37 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:50:37.666363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e21dd-3f27-4d3c-a382-bec9cecdf910 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:37.686739 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:37.784054 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e21dd-3f27-4d3c-a382-bec9cecdf910 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:37.820757 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887978-e92d-41d7-b45e-93dff7a1446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:37.821612 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887978-e92d-41d7-b45e-93dff7a1446e None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:37.821896 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887978-e92d-41d7-b45e-93dff7a1446e None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:37.822150 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887978-e92d-41d7-b45e-93dff7a1446e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:37.834079 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09887978-e92d-41d7-b45e-93dff7a1446e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-09887978-e92d-41d7-b45e-93dff7a1446e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:50:37.843548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:37.844577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:37.846783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:37.846783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:37.846783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:37.846783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:37.846783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:50:37.846783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:50:37.846783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:50:37.846783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:50:37.846783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:50:37.846783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:50:37.846783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:50:37.846783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:37.846783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 430/870] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:50:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:37.851793 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2fb93-83d7-4f74-857e-bbaae1f23d30 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:37.955489 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2fb93-83d7-4f74-857e-bbaae1f23d30 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:37.985209 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:37.994766 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e11e0c-805e-4a7c-b6c2-aec867a023fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:37.995481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11e0c-805e-4a7c-b6c2-aec867a023fd None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:37.995802 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11e0c-805e-4a7c-b6c2-aec867a023fd None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:37.996148 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11e0c-805e-4a7c-b6c2-aec867a023fd None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:37.996926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e11e0c-805e-4a7c-b6c2-aec867a023fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:37.997239 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e11e0c-805e-4a7c-b6c2-aec867a023fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:37.998627 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e11e0c-805e-4a7c-b6c2-aec867a023fd None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:38.007928 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 441/871] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:50:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:38.013886 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887978-e92d-41d7-b45e-93dff7a1446e None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:38.101581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:38.127955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887978-e92d-41d7-b45e-93dff7a1446e None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:38.164355 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d4648-17ee-4e1c-8c3c-dcad93c41adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:38.165148 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d4648-17ee-4e1c-8c3c-dcad93c41adc None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:38.165435 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d4648-17ee-4e1c-8c3c-dcad93c41adc None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:38.165713 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d4648-17ee-4e1c-8c3c-dcad93c41adc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:38.177715 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d4648-17ee-4e1c-8c3c-dcad93c41adc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:38.179877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d4648-17ee-4e1c-8c3c-dcad93c41adc None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:38.198840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-e08d4648-17ee-4e1c-8c3c-dcad93c41adc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:38.198840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:38.198840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:38.198840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:38.198840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:38.198840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:38.198840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:38.198840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:38.198840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:38.198840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:38.198840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:38.198840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:38.198840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:50:38.198840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:50:38.198840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:38.200048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:38.201079 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:50:38.201079 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:50:38.201079 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:38.201079 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:38.201079 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 431/872] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:50:38.207413 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e11e0c-805e-4a7c-b6c2-aec867a023fd None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:38.316796 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e11e0c-805e-4a7c-b6c2-aec867a023fd None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:38.355884 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43194b8f-5798-463e-9a4c-d2c7623b95d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:38.356569 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43194b8f-5798-463e-9a4c-d2c7623b95d2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:38.356853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43194b8f-5798-463e-9a4c-d2c7623b95d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:38.357131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43194b8f-5798-463e-9a4c-d2c7623b95d2 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:38.357877 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43194b8f-5798-463e-9a4c-d2c7623b95d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:38.358168 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43194b8f-5798-463e-9a4c-d2c7623b95d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:38.359532 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43194b8f-5798-463e-9a4c-d2c7623b95d2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:38.373450 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 442/873] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:38.380805 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d4648-17ee-4e1c-8c3c-dcad93c41adc None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:38.497044 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d4648-17ee-4e1c-8c3c-dcad93c41adc None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:38.530205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:38.539624 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95c9ca-00ec-4a5f-92ee-a6797c589906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:38.540523 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95c9ca-00ec-4a5f-92ee-a6797c589906 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:38.540847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95c9ca-00ec-4a5f-92ee-a6797c589906 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:38.541224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95c9ca-00ec-4a5f-92ee-a6797c589906 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:38.549996 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95c9ca-00ec-4a5f-92ee-a6797c589906 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:38.551505 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95c9ca-00ec-4a5f-92ee-a6797c589906 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-ba95c9ca-00ec-4a5f-92ee-a6797c589906 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:50:38.567297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:38.568439 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:38.569371 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:38.569371 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:38.569371 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:50:38.569371 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:50:38.569371 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:50:38.569371 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:50:38.569371 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:50:38.569371 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:50:38.569371 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:50:38.569371 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:38.569371 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 432/874] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:38.575323 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43194b8f-5798-463e-9a4c-d2c7623b95d2 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:38.631562 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:38.688135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43194b8f-5798-463e-9a4c-d2c7623b95d2 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:38.726224 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d7aac-e2ad-4df4-ad02-eeb9dfbd3af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:38.726921 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d7aac-e2ad-4df4-ad02-eeb9dfbd3af7 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:38.727211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d7aac-e2ad-4df4-ad02-eeb9dfbd3af7 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:38.727492 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d7aac-e2ad-4df4-ad02-eeb9dfbd3af7 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:38.728642 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d7aac-e2ad-4df4-ad02-eeb9dfbd3af7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:38.728954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d7aac-e2ad-4df4-ad02-eeb9dfbd3af7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:38.730477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d7aac-e2ad-4df4-ad02-eeb9dfbd3af7 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:38.750173 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 443/875] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Jul 14 11:50:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:38.757852 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95c9ca-00ec-4a5f-92ee-a6797c589906 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:38.879967 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95c9ca-00ec-4a5f-92ee-a6797c589906 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:38.915586 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b764a89-5074-44aa-8d61-79591236ba8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:38.916223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b764a89-5074-44aa-8d61-79591236ba8f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:38.916510 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b764a89-5074-44aa-8d61-79591236ba8f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:38.916792 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b764a89-5074-44aa-8d61-79591236ba8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:38.978849 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:38.992285 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b764a89-5074-44aa-8d61-79591236ba8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:38.993750 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b764a89-5074-44aa-8d61-79591236ba8f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:39.105194 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 433/876] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:50:38 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:50:39.111315 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d7aac-e2ad-4df4-ad02-eeb9dfbd3af7 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:39.219787 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d7aac-e2ad-4df4-ad02-eeb9dfbd3af7 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:39.231025 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:39.256273 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0de238-cb97-48bf-b8a9-1b9d10c8728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:39.257070 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0de238-cb97-48bf-b8a9-1b9d10c8728b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:39.257355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0de238-cb97-48bf-b8a9-1b9d10c8728b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:39.257632 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0de238-cb97-48bf-b8a9-1b9d10c8728b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:39.268388 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0de238-cb97-48bf-b8a9-1b9d10c8728b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:39.269831 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0de238-cb97-48bf-b8a9-1b9d10c8728b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:39.287823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-ba0de238-cb97-48bf-b8a9-1b9d10c8728b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:39.287823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:39.287823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:39.287823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:39.287823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:39.287823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:39.287823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:39.287823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:39.287823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:39.287823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:39.287823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:39.287823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:39.287823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:50:39.287823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:50:39.287823 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:39.288923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:39.290029 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:50:39.290029 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:50:39.290029 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:39.290029 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:39.290029 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 444/877] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:39.294874 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b764a89-5074-44aa-8d61-79591236ba8f None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:39.386296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:39.399217 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b764a89-5074-44aa-8d61-79591236ba8f None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:39.433990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa761a-7afd-4151-9cd6-35ebaca7fbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:39.434583 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa761a-7afd-4151-9cd6-35ebaca7fbf3 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:39.434870 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa761a-7afd-4151-9cd6-35ebaca7fbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:39.435150 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa761a-7afd-4151-9cd6-35ebaca7fbf3 None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:39.435874 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa761a-7afd-4151-9cd6-35ebaca7fbf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:39.436223 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa761a-7afd-4151-9cd6-35ebaca7fbf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:39.437590 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa761a-7afd-4151-9cd6-35ebaca7fbf3 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:39.449523 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 434/878] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:39.456084 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0de238-cb97-48bf-b8a9-1b9d10c8728b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:39.554547 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0de238-cb97-48bf-b8a9-1b9d10c8728b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:39.588835 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c885d1c-b283-4cb6-8a83-7e51304a3c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:39.589624 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c885d1c-b283-4cb6-8a83-7e51304a3c7c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:39.589911 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c885d1c-b283-4cb6-8a83-7e51304a3c7c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:39.590187 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c885d1c-b283-4cb6-8a83-7e51304a3c7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:39.596941 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c885d1c-b283-4cb6-8a83-7e51304a3c7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:39.598378 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c885d1c-b283-4cb6-8a83-7e51304a3c7c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:39.612225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-5c885d1c-b283-4cb6-8a83-7e51304a3c7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:50:39.612225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:39.612225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:39.612225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:39.612225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:39.612225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:39.612225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:39.612225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:39.612225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:39.612225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:39.612225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:39.612225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:39.612225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:50:39.612225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:50:39.612225 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:39.613260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:39.614322 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:50:39.614322 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:50:39.614322 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:50:39.614322 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:50:39.614322 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:50:39.614322 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:50:39.614322 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:50:39.614322 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:39.614322 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 445/879] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:50:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:39.619168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa761a-7afd-4151-9cd6-35ebaca7fbf3 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:39.717644 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa761a-7afd-4151-9cd6-35ebaca7fbf3 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:39.750667 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37561765-bc1c-4c9a-949b-ba9b9ab1eeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:39.751325 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37561765-bc1c-4c9a-949b-ba9b9ab1eeb6 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:39.752233 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37561765-bc1c-4c9a-949b-ba9b9ab1eeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:39.752626 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37561765-bc1c-4c9a-949b-ba9b9ab1eeb6 None admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:39.753291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37561765-bc1c-4c9a-949b-ba9b9ab1eeb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:39.753603 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37561765-bc1c-4c9a-949b-ba9b9ab1eeb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:39.755026 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37561765-bc1c-4c9a-949b-ba9b9ab1eeb6 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:39.768664 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 435/880] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:50:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:39.776103 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c885d1c-b283-4cb6-8a83-7e51304a3c7c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:39.802659 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:39.887945 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c885d1c-b283-4cb6-8a83-7e51304a3c7c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:39.921812 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a302a-e73a-4919-8c30-cac8e470a126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:39.922470 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a302a-e73a-4919-8c30-cac8e470a126 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:39.922760 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a302a-e73a-4919-8c30-cac8e470a126 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:39.923042 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a302a-e73a-4919-8c30-cac8e470a126 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:39.924905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a302a-e73a-4919-8c30-cac8e470a126 None admin] RBAC: Adding query filter params (role.id=321ee52ce1bc4eafa201f23f55f23d2b, scope.project.id=b711bbd57a5446a39ee7c2cf96356083, user.id=de477915cf5e41e8a65a57e8b546997f) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:39.925229 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a302a-e73a-4919-8c30-cac8e470a126 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:39.926664 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a302a-e73a-4919-8c30-cac8e470a126 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:39.932193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 446/881] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:50:39 2022] GET /identity/v3/role_assignments?user.id=de477915cf5e41e8a65a57e8b546997f&scope.project.id=b711bbd57a5446a39ee7c2cf96356083&role.id=321ee52ce1bc4eafa201f23f55f23d2b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:42.165837 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa230d04-2244-4048-8a3d-1af76c8a903c None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:42.166369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa230d04-2244-4048-8a3d-1af76c8a903c None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:42.166459 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa230d04-2244-4048-8a3d-1af76c8a903c None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:42.167776 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 436/882] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:50:42.172973 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f5045-305f-4946-aaca-776118e22fb3 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:42.173367 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f5045-305f-4946-aaca-776118e22fb3 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:42.174062 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f5045-305f-4946-aaca-776118e22fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:42.191201 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-aa8f5045-305f-4946-aaca-776118e22fb3 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:50:42.192433 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-aa8f5045-305f-4946-aaca-776118e22fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:50:42.258422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 447/883] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:50:42 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:50:42.282465 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa230d04-2244-4048-8a3d-1af76c8a903c None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:42.294048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:42.384090 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa230d04-2244-4048-8a3d-1af76c8a903c None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:42.417262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e42bcf-443f-4bd0-8bcb-6ae36fe60ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:42.417986 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e42bcf-443f-4bd0-8bcb-6ae36fe60ffd None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:42.418272 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e42bcf-443f-4bd0-8bcb-6ae36fe60ffd None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:42.418551 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e42bcf-443f-4bd0-8bcb-6ae36fe60ffd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:42.428306 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e42bcf-443f-4bd0-8bcb-6ae36fe60ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-e2e42bcf-443f-4bd0-8bcb-6ae36fe60ffd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:50:42.435947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:42.437024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:42.438061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:42.438061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:42.438061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:42.438061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:42.438061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:50:42.438061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:50:42.438061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:50:42.438061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:50:42.438061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:50:42.438061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:50:42.438061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:50:42.438061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:42.438061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 437/884] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:50:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:42.443865 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f5045-305f-4946-aaca-776118e22fb3 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:42.459165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:42.540998 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f5045-305f-4946-aaca-776118e22fb3 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:42.573935 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa30ea-3fbc-41b2-8af9-73f2166981a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:42.574592 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa30ea-3fbc-41b2-8af9-73f2166981a4 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:42.574878 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa30ea-3fbc-41b2-8af9-73f2166981a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:42.575155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa30ea-3fbc-41b2-8af9-73f2166981a4 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:42.575917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa30ea-3fbc-41b2-8af9-73f2166981a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:42.576229 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa30ea-3fbc-41b2-8af9-73f2166981a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:42.577592 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa30ea-3fbc-41b2-8af9-73f2166981a4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:42.586121 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 448/885] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:50:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:42.591781 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e42bcf-443f-4bd0-8bcb-6ae36fe60ffd None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:42.657964 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:42.693158 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e42bcf-443f-4bd0-8bcb-6ae36fe60ffd None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:42.724948 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c53c82-6b6c-4835-8f48-5a7effb14a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:42.725718 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c53c82-6b6c-4835-8f48-5a7effb14a90 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:42.726003 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c53c82-6b6c-4835-8f48-5a7effb14a90 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:42.726279 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c53c82-6b6c-4835-8f48-5a7effb14a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:42.737298 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c53c82-6b6c-4835-8f48-5a7effb14a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:42.738745 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c53c82-6b6c-4835-8f48-5a7effb14a90 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:42.756055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-a0c53c82-6b6c-4835-8f48-5a7effb14a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:42.756055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:42.756055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:42.756055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:42.756055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:42.756055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:42.756055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:42.756055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:42.756055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:42.756055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:42.756055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:42.756055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:42.756055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:50:42.756055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:50:42.756055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:42.757083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:42.758383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:50:42.758383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:50:42.758383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:42.758383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:42.758383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 438/886] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:42.764179 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa30ea-3fbc-41b2-8af9-73f2166981a4 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:42.850591 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:42.874005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa30ea-3fbc-41b2-8af9-73f2166981a4 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:42.907014 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b347a-aada-455c-9ac1-97e2b12d1335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:42.907672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b347a-aada-455c-9ac1-97e2b12d1335 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:42.908079 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b347a-aada-455c-9ac1-97e2b12d1335 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:42.908445 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b347a-aada-455c-9ac1-97e2b12d1335 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:42.909183 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b347a-aada-455c-9ac1-97e2b12d1335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:42.909500 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b347a-aada-455c-9ac1-97e2b12d1335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:42.910872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b347a-aada-455c-9ac1-97e2b12d1335 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:42.922240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 449/887] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:50:42.928514 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c53c82-6b6c-4835-8f48-5a7effb14a90 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:43.026364 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c53c82-6b6c-4835-8f48-5a7effb14a90 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:43.045753 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:43.062845 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4e240-4d4e-49e2-8a19-a830b5f8c29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:43.063646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4e240-4d4e-49e2-8a19-a830b5f8c29f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:43.063979 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4e240-4d4e-49e2-8a19-a830b5f8c29f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:43.064263 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4e240-4d4e-49e2-8a19-a830b5f8c29f None admin] PATH_INFO: `/v3/users/placement` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:43.079525 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4e240-4d4e-49e2-8a19-a830b5f8c29f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:43.081048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4e240-4d4e-49e2-8a19-a830b5f8c29f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-14f4e240-4d4e-49e2-8a19-a830b5f8c29f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:50:43.095092 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:43.096840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:43.098216 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:43.098216 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:43.098216 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:50:43.098216 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:50:43.098216 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:50:43.098216 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:50:43.098216 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:50:43.098216 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:50:43.098216 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:50:43.098216 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:43.098216 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 439/888] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:43.102642 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b347a-aada-455c-9ac1-97e2b12d1335 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:43.200137 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b347a-aada-455c-9ac1-97e2b12d1335 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:43.234417 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6c0fe-1697-4dc3-9a06-f8ef8bcd0697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:43.235072 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6c0fe-1697-4dc3-9a06-f8ef8bcd0697 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:43.235355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6c0fe-1697-4dc3-9a06-f8ef8bcd0697 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:43.235630 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6c0fe-1697-4dc3-9a06-f8ef8bcd0697 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:43.237081 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6c0fe-1697-4dc3-9a06-f8ef8bcd0697 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:43.237387 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6c0fe-1697-4dc3-9a06-f8ef8bcd0697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:43.238796 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6c0fe-1697-4dc3-9a06-f8ef8bcd0697 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:43.241281 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:43.255687 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 450/889] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Jul 14 11:50:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:43.261314 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4e240-4d4e-49e2-8a19-a830b5f8c29f None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:43.359549 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4e240-4d4e-49e2-8a19-a830b5f8c29f None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:43.393334 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9fada-b301-44b7-9106-b2b0efdfc605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:43.394116 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9fada-b301-44b7-9106-b2b0efdfc605 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:43.394408 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9fada-b301-44b7-9106-b2b0efdfc605 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:43.394691 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9fada-b301-44b7-9106-b2b0efdfc605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:43.405696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9fada-b301-44b7-9106-b2b0efdfc605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:43.407175 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9fada-b301-44b7-9106-b2b0efdfc605 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:43.426042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-25a9fada-b301-44b7-9106-b2b0efdfc605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:43.426042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:43.426042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:43.426042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:43.426042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:43.426042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:43.426042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:43.426042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:43.426042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:43.426042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:43.426042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:43.426042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:43.426042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:50:43.426042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:50:43.426042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:43.427125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:43.428377 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:50:43.428377 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:50:43.428377 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:43.428377 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:43.428377 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 440/890] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:43.433049 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6c0fe-1697-4dc3-9a06-f8ef8bcd0697 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:43.530567 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6c0fe-1697-4dc3-9a06-f8ef8bcd0697 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:43.563789 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bf289-8ffc-418d-957e-da8eff4ac5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:43.564674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bf289-8ffc-418d-957e-da8eff4ac5c4 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:43.565139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bf289-8ffc-418d-957e-da8eff4ac5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:43.565425 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bf289-8ffc-418d-957e-da8eff4ac5c4 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:43.566149 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1bf289-8ffc-418d-957e-da8eff4ac5c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:43.566464 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1bf289-8ffc-418d-957e-da8eff4ac5c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:43.567831 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1bf289-8ffc-418d-957e-da8eff4ac5c4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:43.578934 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 451/891] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:43.585064 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9fada-b301-44b7-9106-b2b0efdfc605 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:43.616733 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:43.684467 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9fada-b301-44b7-9106-b2b0efdfc605 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:43.717026 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a965ed-7256-46ec-9a01-9f6ac79863a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:43.717813 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a965ed-7256-46ec-9a01-9f6ac79863a0 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:43.718100 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a965ed-7256-46ec-9a01-9f6ac79863a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:43.718379 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a965ed-7256-46ec-9a01-9f6ac79863a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:43.725534 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a965ed-7256-46ec-9a01-9f6ac79863a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:43.726972 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a965ed-7256-46ec-9a01-9f6ac79863a0 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:43.741200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-49a965ed-7256-46ec-9a01-9f6ac79863a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:50:43.741200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:43.741200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:43.741200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:43.741200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:43.741200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:43.741200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:43.741200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:43.741200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:43.741200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:43.741200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:43.741200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:43.741200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:50:43.741200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:50:43.741200 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:43.742220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:43.743309 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:50:43.743309 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:50:43.743309 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:50:43.743309 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:50:43.743309 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:50:43.743309 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:50:43.743309 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:50:43.743309 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:43.743309 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 441/892] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:50:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:43.748260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bf289-8ffc-418d-957e-da8eff4ac5c4 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:43.805299 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:43.849702 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bf289-8ffc-418d-957e-da8eff4ac5c4 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:43.882615 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b63a7-ea34-496b-b7f8-95f829eb441e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:43.883200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b63a7-ea34-496b-b7f8-95f829eb441e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:43.883488 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b63a7-ea34-496b-b7f8-95f829eb441e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:43.883768 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b63a7-ea34-496b-b7f8-95f829eb441e None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:43.884581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b63a7-ea34-496b-b7f8-95f829eb441e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:43.884924 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b63a7-ea34-496b-b7f8-95f829eb441e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:43.886363 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b63a7-ea34-496b-b7f8-95f829eb441e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:43.899290 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 452/893] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:50:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:43.905270 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a965ed-7256-46ec-9a01-9f6ac79863a0 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:43.993757 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:44.002907 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a965ed-7256-46ec-9a01-9f6ac79863a0 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:44.036715 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5ec9f-928e-4472-a99a-4a1b6843adee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:44.037576 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5ec9f-928e-4472-a99a-4a1b6843adee None admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:44.037860 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5ec9f-928e-4472-a99a-4a1b6843adee None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:44.038139 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5ec9f-928e-4472-a99a-4a1b6843adee None admin] PATH_INFO: `/v3/projects/b711bbd57a5446a39ee7c2cf96356083/users/de477915cf5e41e8a65a57e8b546997f/roles/321ee52ce1bc4eafa201f23f55f23d2b` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:44.040089 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5ec9f-928e-4472-a99a-4a1b6843adee None admin] RBAC: Authorizing `identity:create_grant(project_id=b711bbd57a5446a39ee7c2cf96356083, user_id=de477915cf5e41e8a65a57e8b546997f, role_id=321ee52ce1bc4eafa201f23f55f23d2b)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:44.041515 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5ec9f-928e-4472-a99a-4a1b6843adee None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:44.054421 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 442/894] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 14 11:50:43 2022] PUT /identity/v3/projects/b711bbd57a5446a39ee7c2cf96356083/users/de477915cf5e41e8a65a57e8b546997f/roles/321ee52ce1bc4eafa201f23f55f23d2b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:50:46.259348 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0de7c3-168c-4238-9d53-99d520788ea2 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:46.259846 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0de7c3-168c-4238-9d53-99d520788ea2 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:46.259982 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0de7c3-168c-4238-9d53-99d520788ea2 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:46.261316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 453/895] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:50:46.266572 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b46f11-4a62-4ac2-98dd-a9523247bd06 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:46.267002 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b46f11-4a62-4ac2-98dd-a9523247bd06 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:46.267102 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b46f11-4a62-4ac2-98dd-a9523247bd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:46.284181 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-57b46f11-4a62-4ac2-98dd-a9523247bd06 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:50:46.285729 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-57b46f11-4a62-4ac2-98dd-a9523247bd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:50:46.349617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 443/896] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:50:46 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:50:46.374741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0de7c3-168c-4238-9d53-99d520788ea2 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:46.473629 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0de7c3-168c-4238-9d53-99d520788ea2 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:46.487108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:46.506828 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101faf75-5b1b-460c-8748-8f97a2144cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:46.507611 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101faf75-5b1b-460c-8748-8f97a2144cf5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:46.507910 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101faf75-5b1b-460c-8748-8f97a2144cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:46.508191 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101faf75-5b1b-460c-8748-8f97a2144cf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:46.518626 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101faf75-5b1b-460c-8748-8f97a2144cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-101faf75-5b1b-460c-8748-8f97a2144cf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:50:46.526359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:46.527468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:46.528452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:46.528452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:46.528452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:46.528452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:46.528452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:50:46.528452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:50:46.528452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:50:46.528452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:50:46.528452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:50:46.528452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:50:46.528452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:50:46.528452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:46.528452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 454/897] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 14 11:50:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:46.534184 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b46f11-4a62-4ac2-98dd-a9523247bd06 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:46.612335 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:46.630618 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b46f11-4a62-4ac2-98dd-a9523247bd06 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:46.664500 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38176885-20c2-4d65-a768-f28dd3d231ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:46.665160 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38176885-20c2-4d65-a768-f28dd3d231ab None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:46.665450 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38176885-20c2-4d65-a768-f28dd3d231ab None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:46.665729 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38176885-20c2-4d65-a768-f28dd3d231ab None admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:46.666468 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38176885-20c2-4d65-a768-f28dd3d231ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:46.666778 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38176885-20c2-4d65-a768-f28dd3d231ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:46.668174 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38176885-20c2-4d65-a768-f28dd3d231ab None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:46.676135 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 444/898] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 14 11:50:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:46.681934 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101faf75-5b1b-460c-8748-8f97a2144cf5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:46.787043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101faf75-5b1b-460c-8748-8f97a2144cf5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:46.827738 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d955ac9-0ebf-43d0-b9c8-4fddf99dff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:46.828637 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d955ac9-0ebf-43d0-b9c8-4fddf99dff92 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:46.828945 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d955ac9-0ebf-43d0-b9c8-4fddf99dff92 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:46.829229 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d955ac9-0ebf-43d0-b9c8-4fddf99dff92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:46.841324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d955ac9-0ebf-43d0-b9c8-4fddf99dff92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:46.842765 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d955ac9-0ebf-43d0-b9c8-4fddf99dff92 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:46.859598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-8d955ac9-0ebf-43d0-b9c8-4fddf99dff92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:46.859598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:46.859598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:46.859598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:46.859598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:46.859598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:46.859598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:46.859598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:46.859598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:46.859598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:46.859598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:46.859598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:46.859598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:50:46.859598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:50:46.859598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:46.860663 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:46.861725 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:50:46.861725 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:50:46.861725 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:46.861725 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:46.861725 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 455/899] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:46.867220 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38176885-20c2-4d65-a768-f28dd3d231ab None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:46.967069 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38176885-20c2-4d65-a768-f28dd3d231ab None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:47.000053 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccc103-29d1-4f05-878f-9076b38d47fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:47.000709 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccc103-29d1-4f05-878f-9076b38d47fb None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:47.000992 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccc103-29d1-4f05-878f-9076b38d47fb None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:47.001265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccc103-29d1-4f05-878f-9076b38d47fb None admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:47.001974 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccc103-29d1-4f05-878f-9076b38d47fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:47.002782 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccc103-29d1-4f05-878f-9076b38d47fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:47.004188 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccc103-29d1-4f05-878f-9076b38d47fb None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:47.015549 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 445/900] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:47.022598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d955ac9-0ebf-43d0-b9c8-4fddf99dff92 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:47.049666 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:47.130038 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d955ac9-0ebf-43d0-b9c8-4fddf99dff92 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:47.163071 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cc3ee-bbff-46d4-98b1-daae07d31953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:47.163865 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc3ee-bbff-46d4-98b1-daae07d31953 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:47.164189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc3ee-bbff-46d4-98b1-daae07d31953 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:47.164470 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc3ee-bbff-46d4-98b1-daae07d31953 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:47.172441 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cc3ee-bbff-46d4-98b1-daae07d31953 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:47.173907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cc3ee-bbff-46d4-98b1-daae07d31953 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-389cc3ee-bbff-46d4-98b1-daae07d31953 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:50:47.189220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:47.191249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:47.192252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:47.192252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:47.192252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:50:47.192252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:50:47.192252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:50:47.192252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:50:47.192252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:50:47.192252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:50:47.192252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:50:47.192252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:47.192252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 456/901] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:47.197519 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccc103-29d1-4f05-878f-9076b38d47fb None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:47.201275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:47.293586 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccc103-29d1-4f05-878f-9076b38d47fb None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:47.326808 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea7530-d3c2-4cbe-9ae4-80c1b943f5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:47.327397 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea7530-d3c2-4cbe-9ae4-80c1b943f5e0 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:47.327683 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea7530-d3c2-4cbe-9ae4-80c1b943f5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:47.327991 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea7530-d3c2-4cbe-9ae4-80c1b943f5e0 None admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:47.328805 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea7530-d3c2-4cbe-9ae4-80c1b943f5e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:47.329113 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea7530-d3c2-4cbe-9ae4-80c1b943f5e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:47.330549 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea7530-d3c2-4cbe-9ae4-80c1b943f5e0 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:47.347371 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 446/902] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Jul 14 11:50:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:47.353631 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cc3ee-bbff-46d4-98b1-daae07d31953 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:47.445418 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:47.460229 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cc3ee-bbff-46d4-98b1-daae07d31953 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:47.492777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ffc10-26ba-47ff-a89d-98d886fa44d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:47.493413 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ffc10-26ba-47ff-a89d-98d886fa44d9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:47.493697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ffc10-26ba-47ff-a89d-98d886fa44d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:47.493976 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ffc10-26ba-47ff-a89d-98d886fa44d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:47.559056 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ffc10-26ba-47ff-a89d-98d886fa44d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:47.560535 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ffc10-26ba-47ff-a89d-98d886fa44d9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:47.639488 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:47.654469 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 457/903] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 14 11:50:47 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:50:47.660747 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea7530-d3c2-4cbe-9ae4-80c1b943f5e0 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:47.726652 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:47.769256 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea7530-d3c2-4cbe-9ae4-80c1b943f5e0 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:47.805052 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb5972-ddb2-49d5-b71f-3eb405632821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:47.805820 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb5972-ddb2-49d5-b71f-3eb405632821 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:47.806107 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb5972-ddb2-49d5-b71f-3eb405632821 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:47.806384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb5972-ddb2-49d5-b71f-3eb405632821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:47.816748 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb5972-ddb2-49d5-b71f-3eb405632821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:47.818197 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb5972-ddb2-49d5-b71f-3eb405632821 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:47.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-92eb5972-ddb2-49d5-b71f-3eb405632821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:47.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:47.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:47.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:47.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:47.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:47.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:47.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:47.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:47.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:47.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:47.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:47.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:50:47.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:50:47.835301 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:47.836346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:47.837314 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:50:47.837314 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:50:47.837314 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:50:47.837314 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:47.837314 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 447/904] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:47.842184 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ffc10-26ba-47ff-a89d-98d886fa44d9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:47.939473 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ffc10-26ba-47ff-a89d-98d886fa44d9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:47.972112 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5aa9a-33a4-44b3-9296-5ca2fa6506c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:47.972755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5aa9a-33a4-44b3-9296-5ca2fa6506c6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:47.973037 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5aa9a-33a4-44b3-9296-5ca2fa6506c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:47.973314 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5aa9a-33a4-44b3-9296-5ca2fa6506c6 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:47.974017 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5aa9a-33a4-44b3-9296-5ca2fa6506c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:47.974321 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5aa9a-33a4-44b3-9296-5ca2fa6506c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:47.975666 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5aa9a-33a4-44b3-9296-5ca2fa6506c6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:47.986738 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 458/905] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 14 11:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:47.992507 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb5972-ddb2-49d5-b71f-3eb405632821 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:48.091428 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb5972-ddb2-49d5-b71f-3eb405632821 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:48.106085 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:48.126131 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d319be-918a-49c6-8a65-0202a50d4987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:48.126916 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d319be-918a-49c6-8a65-0202a50d4987 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:48.127226 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d319be-918a-49c6-8a65-0202a50d4987 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:48.127694 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d319be-918a-49c6-8a65-0202a50d4987 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:48.134288 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d319be-918a-49c6-8a65-0202a50d4987 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:48.135735 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d319be-918a-49c6-8a65-0202a50d4987 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:48.150078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application [None req-80d319be-918a-49c6-8a65-0202a50d4987 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:50:48.150078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:48.150078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:48.150078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:48.150078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:48.150078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:48.150078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:48.150078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:48.150078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:48.150078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:48.150078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:48.150078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:48.150078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:50:48.150078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:50:48.150078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:48.151058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:48.152194 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:50:48.152194 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:50:48.152194 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:50:48.152194 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:50:48.152194 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:50:48.152194 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:50:48.152194 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:50:48.152194 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: ERROR keystone.server.flask.application Jul 14 11:50:48.152194 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 448/906] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 14 11:50:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:50:48.157105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5aa9a-33a4-44b3-9296-5ca2fa6506c6 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:48.202904 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:48.255308 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5aa9a-33a4-44b3-9296-5ca2fa6506c6 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:48.287659 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5182a88-afda-4b3e-804f-186b982ca34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:48.288344 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5182a88-afda-4b3e-804f-186b982ca34d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:48.288636 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5182a88-afda-4b3e-804f-186b982ca34d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:48.288943 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5182a88-afda-4b3e-804f-186b982ca34d None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:48.289721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5182a88-afda-4b3e-804f-186b982ca34d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:48.290035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5182a88-afda-4b3e-804f-186b982ca34d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:48.291459 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5182a88-afda-4b3e-804f-186b982ca34d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:48.303201 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 459/907] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 14 11:50:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:48.309193 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d319be-918a-49c6-8a65-0202a50d4987 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:48.406877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d319be-918a-49c6-8a65-0202a50d4987 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:48.438569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de4ab3-e186-4097-8af4-b6ed8deb8e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:48.439196 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de4ab3-e186-4097-8af4-b6ed8deb8e86 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:48.439477 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de4ab3-e186-4097-8af4-b6ed8deb8e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:48.439748 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de4ab3-e186-4097-8af4-b6ed8deb8e86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:48.440579 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de4ab3-e186-4097-8af4-b6ed8deb8e86 None admin] RBAC: Adding query filter params (role.id=321ee52ce1bc4eafa201f23f55f23d2b, scope.project.id=b711bbd57a5446a39ee7c2cf96356083, user.id=de477915cf5e41e8a65a57e8b546997f) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:48.440888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de4ab3-e186-4097-8af4-b6ed8deb8e86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:48.442825 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de4ab3-e186-4097-8af4-b6ed8deb8e86 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:48.448459 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 449/908] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 14 11:50:48 2022] GET /identity/v3/role_assignments?user.id=de477915cf5e41e8a65a57e8b546997f&scope.project.id=b711bbd57a5446a39ee7c2cf96356083&role.id=321ee52ce1bc4eafa201f23f55f23d2b => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:50.693734 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a72156-381c-449f-8394-66696d501044 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:50.694278 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a72156-381c-449f-8394-66696d501044 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:50.694278 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a72156-381c-449f-8394-66696d501044 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:50.695648 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 460/909] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:50:50.700888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818de1d6-0479-4246-8978-629ee955c983 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:50.701252 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818de1d6-0479-4246-8978-629ee955c983 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:50.701460 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818de1d6-0479-4246-8978-629ee955c983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:50.718502 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-818de1d6-0479-4246-8978-629ee955c983 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:50:50.719722 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-818de1d6-0479-4246-8978-629ee955c983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:50:50.750063 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:50.794814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 450/910] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:50:50 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:50:50.822448 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a72156-381c-449f-8394-66696d501044 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:50.921710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a72156-381c-449f-8394-66696d501044 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:50.929540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:50.955586 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4de43-afc7-460f-a3c9-a0650b6cbe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:50.956358 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4de43-afc7-460f-a3c9-a0650b6cbe31 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:50.956647 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4de43-afc7-460f-a3c9-a0650b6cbe31 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:50.957453 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4de43-afc7-460f-a3c9-a0650b6cbe31 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:50.958283 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4de43-afc7-460f-a3c9-a0650b6cbe31 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:50.959656 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4de43-afc7-460f-a3c9-a0650b6cbe31 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-dfd4de43-afc7-460f-a3c9-a0650b6cbe31 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:50.971324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:50.978430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:50.979744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:50.979744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:50.979744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:50.979744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:50.979744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:50.979744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:50.979744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:50.979744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:50.979744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:50.979744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:50.979744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:50:50.979744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:50:50.979744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:50:50.979744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:50.979744 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 461/911] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Jul 14 11:50:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:50.980749 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818de1d6-0479-4246-8978-629ee955c983 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:51.079187 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818de1d6-0479-4246-8978-629ee955c983 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:51.113188 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a31cb-46a0-4db3-ab81-a305b07d4648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:51.113841 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a31cb-46a0-4db3-ab81-a305b07d4648 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:51.114126 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a31cb-46a0-4db3-ab81-a305b07d4648 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:51.114405 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a31cb-46a0-4db3-ab81-a305b07d4648 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:51.115106 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a31cb-46a0-4db3-ab81-a305b07d4648 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:51.115416 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a31cb-46a0-4db3-ab81-a305b07d4648 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:51.116807 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a31cb-46a0-4db3-ab81-a305b07d4648 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:51.121465 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 451/912] 10.222.0.49 () {56 vars in 1116 bytes} [Thu Jul 14 11:50:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:51.127130 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4de43-afc7-460f-a3c9-a0650b6cbe31 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:51.226699 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4de43-afc7-460f-a3c9-a0650b6cbe31 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:51.259438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426494a0-21ff-455c-8781-98a8f2ebacb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:51.260114 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426494a0-21ff-455c-8781-98a8f2ebacb9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:51.260406 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426494a0-21ff-455c-8781-98a8f2ebacb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:51.260692 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426494a0-21ff-455c-8781-98a8f2ebacb9 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:51.261388 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426494a0-21ff-455c-8781-98a8f2ebacb9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:51.261700 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426494a0-21ff-455c-8781-98a8f2ebacb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:51.263060 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426494a0-21ff-455c-8781-98a8f2ebacb9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:51.267377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 462/913] 10.222.0.49 () {56 vars in 1116 bytes} [Thu Jul 14 11:50:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:53.476647 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b88fb-7ecd-428a-aa28-d9f4677b5619 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:53.477192 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b88fb-7ecd-428a-aa28-d9f4677b5619 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:53.477192 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b88fb-7ecd-428a-aa28-d9f4677b5619 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:53.478511 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 452/914] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:50:53.483770 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c39d1-adbe-4ad8-85f2-6f818ad3087a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:53.484180 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c39d1-adbe-4ad8-85f2-6f818ad3087a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:53.484365 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c39d1-adbe-4ad8-85f2-6f818ad3087a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:53.501090 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-350c39d1-adbe-4ad8-85f2-6f818ad3087a None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:50:53.502256 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-350c39d1-adbe-4ad8-85f2-6f818ad3087a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:50:53.528204 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:53.567712 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 463/915] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:50:53 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:50:53.590861 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b88fb-7ecd-428a-aa28-d9f4677b5619 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:53.622746 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:53.695138 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b88fb-7ecd-428a-aa28-d9f4677b5619 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:53.728967 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872908bd-d2f8-4573-89a9-e19d3eb16967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:53.729816 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872908bd-d2f8-4573-89a9-e19d3eb16967 None admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:53.730104 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872908bd-d2f8-4573-89a9-e19d3eb16967 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:53.730387 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872908bd-d2f8-4573-89a9-e19d3eb16967 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:53.731113 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872908bd-d2f8-4573-89a9-e19d3eb16967 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:53.732514 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872908bd-d2f8-4573-89a9-e19d3eb16967 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:53.746521 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 453/916] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 14 11:50:53 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:50:56.001468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f191e5-ea86-4fb2-b538-b7324091feab None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:56.002043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f191e5-ea86-4fb2-b538-b7324091feab None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:56.002043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f191e5-ea86-4fb2-b538-b7324091feab None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:56.003394 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 464/917] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:50:56.008700 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0007249-915a-41a3-98e2-8a304bee5dc3 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:56.009087 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0007249-915a-41a3-98e2-8a304bee5dc3 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:56.009269 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0007249-915a-41a3-98e2-8a304bee5dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:56.026826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-c0007249-915a-41a3-98e2-8a304bee5dc3 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:50:56.028062 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-c0007249-915a-41a3-98e2-8a304bee5dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:50:56.102064 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 454/918] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:50:56 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:50:56.126959 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f191e5-ea86-4fb2-b538-b7324091feab None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:56.230510 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f191e5-ea86-4fb2-b538-b7324091feab None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:56.262519 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268300db-213c-488b-b481-ee9a6703bfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:56.263247 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268300db-213c-488b-b481-ee9a6703bfb0 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:56.263531 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268300db-213c-488b-b481-ee9a6703bfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:56.263807 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268300db-213c-488b-b481-ee9a6703bfb0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:56.264585 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268300db-213c-488b-b481-ee9a6703bfb0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:56.265939 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268300db-213c-488b-b481-ee9a6703bfb0 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-268300db-213c-488b-b481-ee9a6703bfb0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:56.277946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:56.279074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:56.279948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:56.279948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:56.279948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:56.279948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:56.279948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:56.279948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:56.279948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:56.279948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:56.279948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:56.279948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:56.279948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:50:56.279948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:50:56.279948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:50:56.279948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:56.279948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 465/919] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Jul 14 11:50:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:56.285109 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0007249-915a-41a3-98e2-8a304bee5dc3 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:56.303724 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:56.383697 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0007249-915a-41a3-98e2-8a304bee5dc3 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:56.423296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce0f90-696e-480f-b582-831ead9118d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:56.423990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce0f90-696e-480f-b582-831ead9118d4 None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:56.424273 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce0f90-696e-480f-b582-831ead9118d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:56.424550 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce0f90-696e-480f-b582-831ead9118d4 None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:56.425248 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce0f90-696e-480f-b582-831ead9118d4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:56.425556 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce0f90-696e-480f-b582-831ead9118d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:56.426950 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce0f90-696e-480f-b582-831ead9118d4 None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:56.432022 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 455/920] 10.222.0.49 () {56 vars in 1116 bytes} [Thu Jul 14 11:50:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:56.437959 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268300db-213c-488b-b481-ee9a6703bfb0 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:56.470059 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:56.544688 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268300db-213c-488b-b481-ee9a6703bfb0 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:56.577328 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f390fd5-2bba-438a-bc56-2b43c1555780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:56.577983 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f390fd5-2bba-438a-bc56-2b43c1555780 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:56.578274 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f390fd5-2bba-438a-bc56-2b43c1555780 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:56.578557 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f390fd5-2bba-438a-bc56-2b43c1555780 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:56.579341 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f390fd5-2bba-438a-bc56-2b43c1555780 None admin] RBAC: Adding query filter params (interface=public, service_id=ebd91d7c8ee64383a09f0285e648efed, region_id=RegionOne) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:56.579658 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f390fd5-2bba-438a-bc56-2b43c1555780 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:56.581064 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f390fd5-2bba-438a-bc56-2b43c1555780 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:56.586818 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 466/921] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Jul 14 11:50:56 2022] GET /identity/v3/endpoints?service_id=ebd91d7c8ee64383a09f0285e648efed&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:56.592563 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce0f90-696e-480f-b582-831ead9118d4 None admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:56.671177 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:56.689185 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce0f90-696e-480f-b582-831ead9118d4 None admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:56.722554 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96349780-3e42-43c2-960c-5da5a94c043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:56.723306 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96349780-3e42-43c2-960c-5da5a94c043f None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:56.723614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96349780-3e42-43c2-960c-5da5a94c043f None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:56.723949 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96349780-3e42-43c2-960c-5da5a94c043f None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:56.724622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96349780-3e42-43c2-960c-5da5a94c043f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:56.725991 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96349780-3e42-43c2-960c-5da5a94c043f None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:56.732632 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 456/922] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 14 11:50:56 2022] GET /identity/v3/services => generated 1962 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:50:59.022832 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd2cc9-513f-4506-9273-3bf5b90dcccb None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:59.023376 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd2cc9-513f-4506-9273-3bf5b90dcccb None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:59.023466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd2cc9-513f-4506-9273-3bf5b90dcccb None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:59.024819 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 467/923] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:50:59.029817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e771af3-a344-4665-8a2f-d5b3c012e104 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:59.030231 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e771af3-a344-4665-8a2f-d5b3c012e104 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:59.030384 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e771af3-a344-4665-8a2f-d5b3c012e104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:59.047030 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-5e771af3-a344-4665-8a2f-d5b3c012e104 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:50:59.048239 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-5e771af3-a344-4665-8a2f-d5b3c012e104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:50:59.113237 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 457/924] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:50:59 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:50:59.138177 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd2cc9-513f-4506-9273-3bf5b90dcccb None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:59.229652 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:59.240582 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd2cc9-513f-4506-9273-3bf5b90dcccb None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:59.273953 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6c669-7d2b-4389-b6c1-b9b3791a8f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:59.274687 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6c669-7d2b-4389-b6c1-b9b3791a8f9e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:59.274975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6c669-7d2b-4389-b6c1-b9b3791a8f9e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:59.275255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6c669-7d2b-4389-b6c1-b9b3791a8f9e None admin] PATH_INFO: `/v3/services/placement` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:59.275925 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6c669-7d2b-4389-b6c1-b9b3791a8f9e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:59.277355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6c669-7d2b-4389-b6c1-b9b3791a8f9e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-97e6c669-7d2b-4389-b6c1-b9b3791a8f9e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:50:59.289270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:50:59.290452 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:50:59.291543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:50:59.291543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 14 11:50:59.291543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:50:59.291543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:50:59.291543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:50:59.291543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:50:59.291543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:50:59.291543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:50:59.291543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:50:59.291543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:50:59.291543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:50:59.291543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:50:59.291543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:50:59.291543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 14 11:50:59.291543 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 468/925] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Jul 14 11:50:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:50:59.296450 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e771af3-a344-4665-8a2f-d5b3c012e104 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:59.370888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:59.395515 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e771af3-a344-4665-8a2f-d5b3c012e104 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:59.428444 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f061ad-4fce-4556-b49c-7fad04700ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:59.429174 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f061ad-4fce-4556-b49c-7fad04700ede None admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:59.429622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f061ad-4fce-4556-b49c-7fad04700ede None admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:59.429909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f061ad-4fce-4556-b49c-7fad04700ede None admin] PATH_INFO: `/v3/services` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:59.430614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f061ad-4fce-4556-b49c-7fad04700ede None admin] RBAC: Adding query filter params (name=placement) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:50:59.430929 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f061ad-4fce-4556-b49c-7fad04700ede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:59.432313 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f061ad-4fce-4556-b49c-7fad04700ede None admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:59.437292 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 458/926] 10.222.0.49 () {56 vars in 1116 bytes} [Thu Jul 14 11:50:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:50:59.443612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6c669-7d2b-4389-b6c1-b9b3791a8f9e None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:50:59.541316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6c669-7d2b-4389-b6c1-b9b3791a8f9e None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:50:59.574830 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e98a2d-222c-4797-aa0e-d59ae5bfc37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:50:59.575488 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e98a2d-222c-4797-aa0e-d59ae5bfc37d None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:50:59.575776 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e98a2d-222c-4797-aa0e-d59ae5bfc37d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:50:59.576088 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e98a2d-222c-4797-aa0e-d59ae5bfc37d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:50:59.576822 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e98a2d-222c-4797-aa0e-d59ae5bfc37d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:50:59.578189 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e98a2d-222c-4797-aa0e-d59ae5bfc37d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:50:59.596130 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 469/927] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 14 11:50:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:51:09.435370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=30 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:51:09.591857 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:51:58.698241 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda91d3-84db-48df-a222-05f39695db9d None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:51:58.698983 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda91d3-84db-48df-a222-05f39695db9d None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:51:58.699802 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda91d3-84db-48df-a222-05f39695db9d None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:51:58.702877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 459/928] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:51:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:51:58.709401 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387f50f-5073-4089-9854-73371bcd99cd None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:51:58.709956 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387f50f-5073-4089-9854-73371bcd99cd None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:51:58.709956 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387f50f-5073-4089-9854-73371bcd99cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:51:58.739187 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c387f50f-5073-4089-9854-73371bcd99cd None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:51:58.740599 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c387f50f-5073-4089-9854-73371bcd99cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:51:58.842592 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 470/929] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:51:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:51:58.898252 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb1cd7-904a-4e88-b73f-7a610cd41a2f None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:51:58.898678 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb1cd7-904a-4e88-b73f-7a610cd41a2f None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:51:58.899065 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb1cd7-904a-4e88-b73f-7a610cd41a2f None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:51:58.900780 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 460/930] 10.222.0.49 () {54 vars in 964 bytes} [Thu Jul 14 11:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:51:58.907294 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f39bc-7e47-43f3-8762-ca3a23a35723 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:51:58.907590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f39bc-7e47-43f3-8762-ca3a23a35723 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:51:58.907869 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f39bc-7e47-43f3-8762-ca3a23a35723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:51:58.971267 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b24f39bc-7e47-43f3-8762-ca3a23a35723 None None] MFA Rules not processed for user `336c852c9dfb4c6a8ee62134c2ff32ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:51:58.972597 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b24f39bc-7e47-43f3-8762-ca3a23a35723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:51:59.092095 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 471/931] 10.222.0.49 () {58 vars in 1061 bytes} [Thu Jul 14 11:51:58 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:51:59.093800 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb1cd7-904a-4e88-b73f-7a610cd41a2f None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:51:59.108562 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb1cd7-904a-4e88-b73f-7a610cd41a2f None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:51:59.112661 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58601986-77dc-4ae3-a05e-5b05e38d95af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:51:59.113209 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58601986-77dc-4ae3-a05e-5b05e38d95af service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:51:59.113493 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58601986-77dc-4ae3-a05e-5b05e38d95af service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:51:59.113938 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58601986-77dc-4ae3-a05e-5b05e38d95af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:51:59.124684 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58601986-77dc-4ae3-a05e-5b05e38d95af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:51:59.126151 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58601986-77dc-4ae3-a05e-5b05e38d95af service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:51:59.138649 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 461/932] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:51:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:52:01.702662 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad622d-1533-4a72-898d-f7c319e95cff None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:01.703188 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad622d-1533-4a72-898d-f7c319e95cff None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:01.703296 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad622d-1533-4a72-898d-f7c319e95cff None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:01.704819 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 472/933] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:01.709773 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082e70b-867a-4f6d-8e86-380847c18de9 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:01.710148 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082e70b-867a-4f6d-8e86-380847c18de9 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:01.710334 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082e70b-867a-4f6d-8e86-380847c18de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:01.729019 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-6082e70b-867a-4f6d-8e86-380847c18de9 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:01.730230 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-6082e70b-867a-4f6d-8e86-380847c18de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:01.738488 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 462/934] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:01.778562 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad622d-1533-4a72-898d-f7c319e95cff None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:01.791987 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad622d-1533-4a72-898d-f7c319e95cff None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:01.797428 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85039a04-3931-411e-ad0d-8dd8f8c2c44a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:01.798596 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85039a04-3931-411e-ad0d-8dd8f8c2c44a service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:01.799163 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85039a04-3931-411e-ad0d-8dd8f8c2c44a service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:01.799774 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85039a04-3931-411e-ad0d-8dd8f8c2c44a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:01.812568 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85039a04-3931-411e-ad0d-8dd8f8c2c44a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:01.814131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85039a04-3931-411e-ad0d-8dd8f8c2c44a service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:01.825268 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 473/935] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:52:04.466370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964d5a0-9dd6-4f5f-a2ce-fbce4c7bb263 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:04.466884 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964d5a0-9dd6-4f5f-a2ce-fbce4c7bb263 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:04.466884 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964d5a0-9dd6-4f5f-a2ce-fbce4c7bb263 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:04.468440 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 463/936] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:04.473919 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c9e86-7e1e-4edd-8fd6-352690e2b05d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:04.474371 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c9e86-7e1e-4edd-8fd6-352690e2b05d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:04.474471 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c9e86-7e1e-4edd-8fd6-352690e2b05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:04.513014 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-9a9c9e86-7e1e-4edd-8fd6-352690e2b05d None None] MFA Rules not processed for user `9c838dd213e94d348715998fbd4b45b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:04.514297 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9a9c9e86-7e1e-4edd-8fd6-352690e2b05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:04.557844 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:52:04.586381 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 474/937] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:04 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:04.631241 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964d5a0-9dd6-4f5f-a2ce-fbce4c7bb263 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:04.641902 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964d5a0-9dd6-4f5f-a2ce-fbce4c7bb263 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:04.645811 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114215e0-d1a0-4115-9b3f-929bcf8ae86c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:04.646512 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114215e0-d1a0-4115-9b3f-929bcf8ae86c service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:04.646859 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114215e0-d1a0-4115-9b3f-929bcf8ae86c service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:04.647201 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114215e0-d1a0-4115-9b3f-929bcf8ae86c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:04.656550 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114215e0-d1a0-4115-9b3f-929bcf8ae86c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:04.658036 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114215e0-d1a0-4115-9b3f-929bcf8ae86c service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:04.668346 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 464/938] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:04 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:52:07.500030 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db60cf-9827-4bac-967f-59a9bda0c907 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:07.500555 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db60cf-9827-4bac-967f-59a9bda0c907 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:07.500555 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db60cf-9827-4bac-967f-59a9bda0c907 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:07.501871 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 475/939] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:07.507042 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea3696-d75c-4ae7-9109-fedddb12461c None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:07.507445 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea3696-d75c-4ae7-9109-fedddb12461c None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:07.507606 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea3696-d75c-4ae7-9109-fedddb12461c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:07.525207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-e1ea3696-d75c-4ae7-9109-fedddb12461c None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:07.526394 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-e1ea3696-d75c-4ae7-9109-fedddb12461c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:07.598742 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 465/940] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:07 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:07.639074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db60cf-9827-4bac-967f-59a9bda0c907 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:07.650948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db60cf-9827-4bac-967f-59a9bda0c907 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:07.654445 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78870ebc-4f33-44a9-a635-75fc9532ca02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:07.655076 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78870ebc-4f33-44a9-a635-75fc9532ca02 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:07.655367 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78870ebc-4f33-44a9-a635-75fc9532ca02 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:07.655649 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78870ebc-4f33-44a9-a635-75fc9532ca02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:07.664396 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78870ebc-4f33-44a9-a635-75fc9532ca02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:07.666909 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78870ebc-4f33-44a9-a635-75fc9532ca02 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:07.676211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 476/941] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:07 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:52:10.627617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37684-28c7-436b-91b6-e2034544d28f None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:10.628235 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37684-28c7-436b-91b6-e2034544d28f None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:10.628235 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37684-28c7-436b-91b6-e2034544d28f None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:10.629572 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 466/942] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:10.635771 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2105e4-6488-40db-a380-d7c89f1ae2e5 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:10.636232 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2105e4-6488-40db-a380-d7c89f1ae2e5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:10.636375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2105e4-6488-40db-a380-d7c89f1ae2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:10.654933 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-4c2105e4-6488-40db-a380-d7c89f1ae2e5 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:10.656173 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4c2105e4-6488-40db-a380-d7c89f1ae2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:10.663801 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 477/943] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:10.702930 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da37684-28c7-436b-91b6-e2034544d28f None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:10.713494 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da37684-28c7-436b-91b6-e2034544d28f None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:10.716975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e89b8-eb85-480d-9401-e8abc597a559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:10.717605 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e89b8-eb85-480d-9401-e8abc597a559 service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:10.717888 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e89b8-eb85-480d-9401-e8abc597a559 service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:10.718165 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e89b8-eb85-480d-9401-e8abc597a559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:10.726904 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e89b8-eb85-480d-9401-e8abc597a559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:10.728857 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e89b8-eb85-480d-9401-e8abc597a559 service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:10.738513 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 467/944] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:52:13.036331 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d1774-c8c5-4695-a32a-8ba2fb2e98ea None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:13.036829 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d1774-c8c5-4695-a32a-8ba2fb2e98ea None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:13.036829 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d1774-c8c5-4695-a32a-8ba2fb2e98ea None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:13.038448 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 478/945] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:13.044400 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358f4d7-cdf3-4a6b-aa50-697185e8025b None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:13.044852 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358f4d7-cdf3-4a6b-aa50-697185e8025b None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:13.044967 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358f4d7-cdf3-4a6b-aa50-697185e8025b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:13.063139 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-c358f4d7-cdf3-4a6b-aa50-697185e8025b None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:13.064361 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-c358f4d7-cdf3-4a6b-aa50-697185e8025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:13.072381 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 468/946] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:13.109117 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d1774-c8c5-4695-a32a-8ba2fb2e98ea None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:13.120191 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d1774-c8c5-4695-a32a-8ba2fb2e98ea None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:13.123623 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cf4b4-ac34-4cc4-8295-3a294ee417f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:13.124318 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cf4b4-ac34-4cc4-8295-3a294ee417f3 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:13.124603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cf4b4-ac34-4cc4-8295-3a294ee417f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:13.124882 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cf4b4-ac34-4cc4-8295-3a294ee417f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:13.133552 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cf4b4-ac34-4cc4-8295-3a294ee417f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:13.134996 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cf4b4-ac34-4cc4-8295-3a294ee417f3 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:13.144418 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 479/947] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:52:15.434017 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c8561-88fc-424e-950c-10302d21359f None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:15.434570 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c8561-88fc-424e-950c-10302d21359f None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:15.434570 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c8561-88fc-424e-950c-10302d21359f None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:15.435974 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 469/948] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:15.441185 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319145-d276-49a4-8444-333e0c14cb74 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:15.441593 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319145-d276-49a4-8444-333e0c14cb74 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:15.441745 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319145-d276-49a4-8444-333e0c14cb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:15.458930 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c0319145-d276-49a4-8444-333e0c14cb74 None None] MFA Rules not processed for user `9c838dd213e94d348715998fbd4b45b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:15.460136 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c0319145-d276-49a4-8444-333e0c14cb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:15.467671 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 480/949] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:15 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:52:15.506218 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c8561-88fc-424e-950c-10302d21359f None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:15.516821 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c8561-88fc-424e-950c-10302d21359f None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:15.520178 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5a6bd-2558-4d69-bbf3-616b6cb2e9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:15.520806 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5a6bd-2558-4d69-bbf3-616b6cb2e9ad service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:15.521088 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5a6bd-2558-4d69-bbf3-616b6cb2e9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:15.521362 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5a6bd-2558-4d69-bbf3-616b6cb2e9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:15.530227 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5a6bd-2558-4d69-bbf3-616b6cb2e9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:15.531653 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5a6bd-2558-4d69-bbf3-616b6cb2e9ad service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:15.541838 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 470/950] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:15 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:52:18.022549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d298eb-d89c-4031-9010-26f9bffc189c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:18.023118 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d298eb-d89c-4031-9010-26f9bffc189c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:18.023118 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d298eb-d89c-4031-9010-26f9bffc189c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:18.025076 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 481/951] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:18.031005 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085e262-9d95-4249-844e-9f3569eb7b92 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:18.031507 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085e262-9d95-4249-844e-9f3569eb7b92 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:18.031618 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085e262-9d95-4249-844e-9f3569eb7b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:18.050901 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-5085e262-9d95-4249-844e-9f3569eb7b92 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:18.052154 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-5085e262-9d95-4249-844e-9f3569eb7b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:18.060854 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 471/952] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:18.100200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d298eb-d89c-4031-9010-26f9bffc189c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:18.112205 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d298eb-d89c-4031-9010-26f9bffc189c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:18.115790 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13046943-5236-436f-9aa4-54b3348d1c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:18.116564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13046943-5236-436f-9aa4-54b3348d1c77 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:18.116926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13046943-5236-436f-9aa4-54b3348d1c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:18.117280 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13046943-5236-436f-9aa4-54b3348d1c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:18.127443 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13046943-5236-436f-9aa4-54b3348d1c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:18.128951 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13046943-5236-436f-9aa4-54b3348d1c77 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:18.139515 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 482/953] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:52:20.435427 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21a5a1-e327-4fd0-954d-0b93def32b38 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:20.436202 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21a5a1-e327-4fd0-954d-0b93def32b38 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:20.436202 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21a5a1-e327-4fd0-954d-0b93def32b38 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:20.437431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 472/954] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:20.445286 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ea201-6d5d-4c00-97f8-34e3e17079c5 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:20.445776 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ea201-6d5d-4c00-97f8-34e3e17079c5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:20.445776 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ea201-6d5d-4c00-97f8-34e3e17079c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:20.468644 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ce7ea201-6d5d-4c00-97f8-34e3e17079c5 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:20.469921 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ce7ea201-6d5d-4c00-97f8-34e3e17079c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:20.483967 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 483/955] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:20.521144 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21a5a1-e327-4fd0-954d-0b93def32b38 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:20.526709 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=65 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:52:20.533619 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21a5a1-e327-4fd0-954d-0b93def32b38 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:20.537395 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536d0af-cd75-48af-84d8-0a19eb37b619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:20.538257 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536d0af-cd75-48af-84d8-0a19eb37b619 service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:20.538533 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536d0af-cd75-48af-84d8-0a19eb37b619 service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:20.539003 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536d0af-cd75-48af-84d8-0a19eb37b619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:20.549177 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536d0af-cd75-48af-84d8-0a19eb37b619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:20.550788 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536d0af-cd75-48af-84d8-0a19eb37b619 service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:20.561162 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 473/956] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:52:23.138289 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621569d-f6ef-4c14-8e81-c69f3810341f None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:23.138820 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621569d-f6ef-4c14-8e81-c69f3810341f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:23.138911 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621569d-f6ef-4c14-8e81-c69f3810341f None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:23.140252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 484/957] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:23.145516 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52947479-a9df-4c23-9fce-6cda28c9b814 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:23.145961 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52947479-a9df-4c23-9fce-6cda28c9b814 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:23.146055 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52947479-a9df-4c23-9fce-6cda28c9b814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:23.163636 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-52947479-a9df-4c23-9fce-6cda28c9b814 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:23.165427 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-52947479-a9df-4c23-9fce-6cda28c9b814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:23.173650 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 474/958] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:23 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:23.210104 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621569d-f6ef-4c14-8e81-c69f3810341f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:23.221617 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621569d-f6ef-4c14-8e81-c69f3810341f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:23.225121 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a51e80-1868-46a1-bf69-6251fc55b22f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:23.225759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51e80-1868-46a1-bf69-6251fc55b22f service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:23.226045 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51e80-1868-46a1-bf69-6251fc55b22f service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:23.226321 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51e80-1868-46a1-bf69-6251fc55b22f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:23.236511 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a51e80-1868-46a1-bf69-6251fc55b22f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:23.237956 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a51e80-1868-46a1-bf69-6251fc55b22f service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:23.247814 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 485/959] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:23 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:52:27.476265 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbb9ec-71d1-4bad-a9f8-603f01c6f477 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:27.476762 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbb9ec-71d1-4bad-a9f8-603f01c6f477 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:27.476762 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbb9ec-71d1-4bad-a9f8-603f01c6f477 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:27.478140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 475/960] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:27.483572 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a4ea4-990d-4a85-ae23-d21abb22ce83 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:27.484035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a4ea4-990d-4a85-ae23-d21abb22ce83 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:27.484201 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a4ea4-990d-4a85-ae23-d21abb22ce83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:27.501914 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-cc8a4ea4-990d-4a85-ae23-d21abb22ce83 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:27.503144 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-cc8a4ea4-990d-4a85-ae23-d21abb22ce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:27.511634 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 486/961] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:27.550867 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbb9ec-71d1-4bad-a9f8-603f01c6f477 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:27.562255 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbb9ec-71d1-4bad-a9f8-603f01c6f477 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:27.565735 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b57e4-ba20-4717-b2f9-60c508c28621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:27.566398 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b57e4-ba20-4717-b2f9-60c508c28621 service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:27.566688 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b57e4-ba20-4717-b2f9-60c508c28621 service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:27.566971 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b57e4-ba20-4717-b2f9-60c508c28621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:27.576895 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b57e4-ba20-4717-b2f9-60c508c28621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:27.578316 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b57e4-ba20-4717-b2f9-60c508c28621 service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:27.588224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 476/962] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:52:30.544120 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f0d73-4122-4ab9-af78-738c5251f4c0 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:30.544631 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f0d73-4122-4ab9-af78-738c5251f4c0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:30.544739 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f0d73-4122-4ab9-af78-738c5251f4c0 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:30.546075 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 487/963] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:30.551400 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569943d-27dc-426b-be9b-f0112ead4d5f None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:30.551814 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569943d-27dc-426b-be9b-f0112ead4d5f None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:30.552002 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569943d-27dc-426b-be9b-f0112ead4d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:30.570427 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-0569943d-27dc-426b-be9b-f0112ead4d5f None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:30.572680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-0569943d-27dc-426b-be9b-f0112ead4d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:30.580521 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 477/964] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:30 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:30.619251 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f0d73-4122-4ab9-af78-738c5251f4c0 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:30.629889 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f0d73-4122-4ab9-af78-738c5251f4c0 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:30.634220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04047e32-2c3a-46a8-bd95-34072ed63b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:30.635109 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047e32-2c3a-46a8-bd95-34072ed63b34 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:30.635485 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047e32-2c3a-46a8-bd95-34072ed63b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:30.635773 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047e32-2c3a-46a8-bd95-34072ed63b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:30.645096 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04047e32-2c3a-46a8-bd95-34072ed63b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:30.646546 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04047e32-2c3a-46a8-bd95-34072ed63b34 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:30.656941 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 488/965] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:30 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:52:34.882842 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f1e29-f8f8-424a-a510-0a7c604c497f None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:34.883867 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f1e29-f8f8-424a-a510-0a7c604c497f None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:34.883867 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f1e29-f8f8-424a-a510-0a7c604c497f None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:34.884912 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 478/966] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:34.890000 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90045c3-6412-4b0f-93f4-8a54901389df None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:34.890381 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90045c3-6412-4b0f-93f4-8a54901389df None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:34.890568 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90045c3-6412-4b0f-93f4-8a54901389df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:34.896537 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=54 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:52:34.909215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a90045c3-6412-4b0f-93f4-8a54901389df None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:34.910424 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a90045c3-6412-4b0f-93f4-8a54901389df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:34.918961 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 489/967] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:34.957572 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f1e29-f8f8-424a-a510-0a7c604c497f None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:34.968447 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f1e29-f8f8-424a-a510-0a7c604c497f None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:34.971877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e81717-1702-4e64-8139-40cf15b12b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:34.972670 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e81717-1702-4e64-8139-40cf15b12b76 service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:34.972962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e81717-1702-4e64-8139-40cf15b12b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:34.973243 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e81717-1702-4e64-8139-40cf15b12b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:34.983122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e81717-1702-4e64-8139-40cf15b12b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:34.984591 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e81717-1702-4e64-8139-40cf15b12b76 service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:34.994730 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 479/968] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:52:40.464368 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661ab02-bfe2-4fbf-92d6-9c58106de6c9 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:40.464368 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661ab02-bfe2-4fbf-92d6-9c58106de6c9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:40.464368 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661ab02-bfe2-4fbf-92d6-9c58106de6c9 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:40.464368 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 490/969] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 14 11:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:40.465582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1ce29-e566-4489-a3e2-0bd823839e20 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:40.465967 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1ce29-e566-4489-a3e2-0bd823839e20 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:40.466138 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1ce29-e566-4489-a3e2-0bd823839e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:40.522721 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-36d1ce29-e566-4489-a3e2-0bd823839e20 None None] MFA Rules not processed for user `de477915cf5e41e8a65a57e8b546997f`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:40.524915 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-36d1ce29-e566-4489-a3e2-0bd823839e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:40.710577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 480/970] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 14 11:52:40 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:52:44.904256 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:52:45.162382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe68e07-22cd-426d-bc5d-51a081448393 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:45.162711 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe68e07-22cd-426d-bc5d-51a081448393 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:45.162946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe68e07-22cd-426d-bc5d-51a081448393 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:45.165131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 491/971] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 14 11:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:45.170208 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56e074-5e6e-4ceb-95a3-4717abf748fa None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:45.170685 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56e074-5e6e-4ceb-95a3-4717abf748fa None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:45.170986 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56e074-5e6e-4ceb-95a3-4717abf748fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:45.198431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-4f56e074-5e6e-4ceb-95a3-4717abf748fa None None] MFA Rules not processed for user `de477915cf5e41e8a65a57e8b546997f`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:45.199962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-4f56e074-5e6e-4ceb-95a3-4717abf748fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:45.209862 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 481/972] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 14 11:52:45 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:46.875048 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f42fff-9f8a-4157-91ed-157b7804ab1b None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:46.875603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f42fff-9f8a-4157-91ed-157b7804ab1b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:46.875603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f42fff-9f8a-4157-91ed-157b7804ab1b None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:46.877198 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 492/973] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 14 11:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:46.882432 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0724781-7527-4638-bb1f-da30c9c21670 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:46.882900 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0724781-7527-4638-bb1f-da30c9c21670 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:46.883178 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0724781-7527-4638-bb1f-da30c9c21670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:46.901755 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-b0724781-7527-4638-bb1f-da30c9c21670 None None] MFA Rules not processed for user `de477915cf5e41e8a65a57e8b546997f`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:46.903128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-b0724781-7527-4638-bb1f-da30c9c21670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:46.911688 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 482/974] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 14 11:52:46 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:52:50.895470 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cf79d-90d1-456f-a815-f7036b082503 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:50.896062 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cf79d-90d1-456f-a815-f7036b082503 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:50.896062 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cf79d-90d1-456f-a815-f7036b082503 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:50.897342 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 493/975] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:50.903193 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e758-d5ac-4145-978a-fec7617ec309 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:50.903609 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e758-d5ac-4145-978a-fec7617ec309 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:50.903758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e758-d5ac-4145-978a-fec7617ec309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:50.910033 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=69 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:52:50.925198 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-4bb3e758-d5ac-4145-978a-fec7617ec309 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:50.926843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-4bb3e758-d5ac-4145-978a-fec7617ec309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:50.939939 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 483/976] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:50.997191 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ffee0-241b-4cdf-83ae-6ede46b6fd9e None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:50.997925 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ffee0-241b-4cdf-83ae-6ede46b6fd9e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:50.998561 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ffee0-241b-4cdf-83ae-6ede46b6fd9e None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:51.000355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 494/977] 10.222.0.49 () {54 vars in 961 bytes} [Thu Jul 14 11:52:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:51.010431 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3c1d4-a1aa-4381-a001-c8b5e3b38fd0 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:51.011429 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3c1d4-a1aa-4381-a001-c8b5e3b38fd0 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:51.012418 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3c1d4-a1aa-4381-a001-c8b5e3b38fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:51.053168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-bfc3c1d4-a1aa-4381-a001-c8b5e3b38fd0 None None] MFA Rules not processed for user `6fd8e197398e465aa3247d2ea89430d8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:51.054467 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-bfc3c1d4-a1aa-4381-a001-c8b5e3b38fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:51.143432 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 484/978] 10.222.0.49 () {58 vars in 1058 bytes} [Thu Jul 14 11:52:51 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:51.151874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ffee0-241b-4cdf-83ae-6ede46b6fd9e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:51.166737 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ffee0-241b-4cdf-83ae-6ede46b6fd9e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:51.172063 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc7661-9444-4e96-975d-4f9b43e204a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:51.172981 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc7661-9444-4e96-975d-4f9b43e204a4 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:51.173366 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc7661-9444-4e96-975d-4f9b43e204a4 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:51.173849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc7661-9444-4e96-975d-4f9b43e204a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:51.184560 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc7661-9444-4e96-975d-4f9b43e204a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:51.186257 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc7661-9444-4e96-975d-4f9b43e204a4 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:51.197576 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 495/979] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:52:53.687960 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312b14-f162-486d-8d2e-ceaab5ca0162 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:53.688513 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312b14-f162-486d-8d2e-ceaab5ca0162 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:53.688513 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312b14-f162-486d-8d2e-ceaab5ca0162 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:53.690033 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 485/980] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:53.694990 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0febdd4-d0d1-4a7d-917a-2646d6b4c57c None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:53.695423 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0febdd4-d0d1-4a7d-917a-2646d6b4c57c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:53.695597 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0febdd4-d0d1-4a7d-917a-2646d6b4c57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:53.713562 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b0febdd4-d0d1-4a7d-917a-2646d6b4c57c None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:53.714772 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b0febdd4-d0d1-4a7d-917a-2646d6b4c57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:53.722650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 496/981] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:53.768395 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75312b14-f162-486d-8d2e-ceaab5ca0162 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:53.782524 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75312b14-f162-486d-8d2e-ceaab5ca0162 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:53.787426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342a505-fef6-48e4-84d0-af4074cb5578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:53.788235 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342a505-fef6-48e4-84d0-af4074cb5578 service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:53.788590 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342a505-fef6-48e4-84d0-af4074cb5578 service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:53.789453 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342a505-fef6-48e4-84d0-af4074cb5578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:53.800923 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342a505-fef6-48e4-84d0-af4074cb5578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:53.802588 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342a505-fef6-48e4-84d0-af4074cb5578 service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:53.814250 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 486/982] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:52:56.409307 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285fc7f-a346-47f6-9292-47537914dbb9 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:56.409815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285fc7f-a346-47f6-9292-47537914dbb9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:56.409951 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285fc7f-a346-47f6-9292-47537914dbb9 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:56.411275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 497/983] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:56.416763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10472e74-02bd-4831-b694-f00439c7504a None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:56.417174 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10472e74-02bd-4831-b694-f00439c7504a None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:56.417437 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10472e74-02bd-4831-b694-f00439c7504a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:56.439917 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-10472e74-02bd-4831-b694-f00439c7504a None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:56.439917 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-10472e74-02bd-4831-b694-f00439c7504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:56.445209 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 487/984] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:56.492761 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4392227-063a-4fe3-b04a-d88a3da612c3 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:56.493101 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4392227-063a-4fe3-b04a-d88a3da612c3 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:56.493389 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4392227-063a-4fe3-b04a-d88a3da612c3 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:56.494755 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 498/985] 10.222.0.49 () {54 vars in 961 bytes} [Thu Jul 14 11:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:56.500048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d3d2c-aaef-42d5-80e5-84286148ed7c None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:56.500455 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d3d2c-aaef-42d5-80e5-84286148ed7c None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:56.500799 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d3d2c-aaef-42d5-80e5-84286148ed7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:56.518602 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-d95d3d2c-aaef-42d5-80e5-84286148ed7c None None] MFA Rules not processed for user `6fd8e197398e465aa3247d2ea89430d8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:56.519807 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-d95d3d2c-aaef-42d5-80e5-84286148ed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:56.532631 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 488/986] 10.222.0.49 () {58 vars in 1058 bytes} [Thu Jul 14 11:52:56 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:56.541252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4392227-063a-4fe3-b04a-d88a3da612c3 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:56.554658 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4392227-063a-4fe3-b04a-d88a3da612c3 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:56.560167 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b49575-ffdd-4a32-b26a-d0d0848a9b09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:56.560803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b49575-ffdd-4a32-b26a-d0d0848a9b09 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:56.561090 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b49575-ffdd-4a32-b26a-d0d0848a9b09 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:56.561370 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b49575-ffdd-4a32-b26a-d0d0848a9b09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:56.569553 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b49575-ffdd-4a32-b26a-d0d0848a9b09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:56.571560 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b49575-ffdd-4a32-b26a-d0d0848a9b09 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:56.581455 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 499/987] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:52:58.967666 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e751b68-1c11-41c0-91d2-18fcf998a71e None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:58.968672 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e751b68-1c11-41c0-91d2-18fcf998a71e None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:58.969520 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e751b68-1c11-41c0-91d2-18fcf998a71e None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:58.973369 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 489/988] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:52:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:52:58.979362 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55bbd1-70f6-4867-a891-758cedf28971 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:58.980655 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55bbd1-70f6-4867-a891-758cedf28971 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:58.980944 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55bbd1-70f6-4867-a891-758cedf28971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:59.002454 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0f55bbd1-70f6-4867-a891-758cedf28971 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:52:59.004921 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0f55bbd1-70f6-4867-a891-758cedf28971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:52:59.016329 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 500/989] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:52:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:52:59.062871 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e751b68-1c11-41c0-91d2-18fcf998a71e None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:52:59.077153 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e751b68-1c11-41c0-91d2-18fcf998a71e None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:52:59.082397 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202f5b0-ba70-474d-a2c4-fc33ad25d4e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:52:59.083642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202f5b0-ba70-474d-a2c4-fc33ad25d4e7 service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:52:59.084125 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202f5b0-ba70-474d-a2c4-fc33ad25d4e7 service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:52:59.084568 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202f5b0-ba70-474d-a2c4-fc33ad25d4e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:52:59.094717 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202f5b0-ba70-474d-a2c4-fc33ad25d4e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:52:59.096736 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202f5b0-ba70-474d-a2c4-fc33ad25d4e7 service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:52:59.107825 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 490/990] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:52:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:01.319612 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc22ec-7285-4a96-8ee5-ac4bc4a11497 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:01.320837 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc22ec-7285-4a96-8ee5-ac4bc4a11497 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:01.320837 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc22ec-7285-4a96-8ee5-ac4bc4a11497 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:01.322140 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 501/991] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:53:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:01.327485 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a43ab9-ce78-41d6-abf1-65aaa95e026c None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:01.328311 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a43ab9-ce78-41d6-abf1-65aaa95e026c None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:01.328600 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a43ab9-ce78-41d6-abf1-65aaa95e026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:01.348076 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-75a43ab9-ce78-41d6-abf1-65aaa95e026c None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:01.349296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-75a43ab9-ce78-41d6-abf1-65aaa95e026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:01.359921 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 491/992] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:53:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:01.584997 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba3ddd-618b-4eaf-b6bd-607789aff3b5 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:01.585210 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba3ddd-618b-4eaf-b6bd-607789aff3b5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:01.586626 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba3ddd-618b-4eaf-b6bd-607789aff3b5 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:01.587808 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 502/993] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:53:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:01.593368 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713305f-78d9-408f-8aa3-a408026675f6 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:01.593667 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713305f-78d9-408f-8aa3-a408026675f6 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:01.593947 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713305f-78d9-408f-8aa3-a408026675f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:01.616311 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-7713305f-78d9-408f-8aa3-a408026675f6 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:01.617569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-7713305f-78d9-408f-8aa3-a408026675f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:01.627201 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 492/994] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:53:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:01.669964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f64600-5011-4bd0-b0ad-a8a2331805bd None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:01.670290 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f64600-5011-4bd0-b0ad-a8a2331805bd None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:01.670583 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f64600-5011-4bd0-b0ad-a8a2331805bd None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:01.671996 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 503/995] 10.222.0.49 () {54 vars in 963 bytes} [Thu Jul 14 11:53:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:01.673314 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713305f-78d9-408f-8aa3-a408026675f6 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:01.677255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677040e4-85f2-4bba-b73f-06ef961bdbab None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:01.677549 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677040e4-85f2-4bba-b73f-06ef961bdbab None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:01.677834 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677040e4-85f2-4bba-b73f-06ef961bdbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:01.686672 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713305f-78d9-408f-8aa3-a408026675f6 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:01.692130 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2d973-7f91-4a18-8eac-0a5f9e911029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:01.692831 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2d973-7f91-4a18-8eac-0a5f9e911029 service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:01.693124 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2d973-7f91-4a18-8eac-0a5f9e911029 service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:01.693405 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2d973-7f91-4a18-8eac-0a5f9e911029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:01.705409 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2d973-7f91-4a18-8eac-0a5f9e911029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:01.707189 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2d973-7f91-4a18-8eac-0a5f9e911029 service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:01.719271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 493/996] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:53:01.721367 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-677040e4-85f2-4bba-b73f-06ef961bdbab None None] MFA Rules not processed for user `ab858f5998b348ecbac54423716b7671`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:01.722858 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-677040e4-85f2-4bba-b73f-06ef961bdbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:01.799502 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 504/997] 10.222.0.49 () {58 vars in 1060 bytes} [Thu Jul 14 11:53:01 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:53:01.807383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2d973-7f91-4a18-8eac-0a5f9e911029 service nova] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:01.817753 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2d973-7f91-4a18-8eac-0a5f9e911029 service nova] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:01.823188 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25096ea8-1750-4e77-8b2e-57b34b63d070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab858f5998b348ecbac54423716b7671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:01.824088 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25096ea8-1750-4e77-8b2e-57b34b63d070 service cinder] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:01.824426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25096ea8-1750-4e77-8b2e-57b34b63d070 service cinder] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:01.824811 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25096ea8-1750-4e77-8b2e-57b34b63d070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:01.836429 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25096ea8-1750-4e77-8b2e-57b34b63d070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:01.837968 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25096ea8-1750-4e77-8b2e-57b34b63d070 service cinder] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:01.849620 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 494/998] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:53:04.091754 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e5065-c701-4cf8-9f77-4664f2c320bc None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:04.092220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e5065-c701-4cf8-9f77-4664f2c320bc None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:04.092393 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e5065-c701-4cf8-9f77-4664f2c320bc None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:04.093785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 505/999] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:04.099273 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbd45d-6f71-4141-93c5-a48123bd31fc None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:04.099693 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbd45d-6f71-4141-93c5-a48123bd31fc None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:04.099842 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbd45d-6f71-4141-93c5-a48123bd31fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:04.120326 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-9acbd45d-6f71-4141-93c5-a48123bd31fc None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:04.121539 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-9acbd45d-6f71-4141-93c5-a48123bd31fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:04.129614 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 495/1000] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:53:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:04.176833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e5065-c701-4cf8-9f77-4664f2c320bc None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:04.192926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e5065-c701-4cf8-9f77-4664f2c320bc None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:04.199240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3614a56-28c9-4dc2-964f-6468c821a225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:04.199916 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3614a56-28c9-4dc2-964f-6468c821a225 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:04.200199 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3614a56-28c9-4dc2-964f-6468c821a225 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:04.200475 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3614a56-28c9-4dc2-964f-6468c821a225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:04.210043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3614a56-28c9-4dc2-964f-6468c821a225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:04.212085 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3614a56-28c9-4dc2-964f-6468c821a225 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:04.222843 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 506/1001] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:06.563822 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d65ee-cbb1-4b76-acc5-52c28eaa10d3 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:06.564417 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d65ee-cbb1-4b76-acc5-52c28eaa10d3 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:06.564417 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d65ee-cbb1-4b76-acc5-52c28eaa10d3 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:06.565662 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 496/1002] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:06.570904 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e59ae6-ebce-471d-a00c-e9e2082b6adf None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:06.571768 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e59ae6-ebce-471d-a00c-e9e2082b6adf None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:06.575411 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e59ae6-ebce-471d-a00c-e9e2082b6adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:06.598105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e2e59ae6-ebce-471d-a00c-e9e2082b6adf None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:06.599299 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e2e59ae6-ebce-471d-a00c-e9e2082b6adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:06.608255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 507/1003] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:53:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:06.667685 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d65ee-cbb1-4b76-acc5-52c28eaa10d3 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:06.682786 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d65ee-cbb1-4b76-acc5-52c28eaa10d3 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:06.687784 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b692ab-32e4-4f81-87c0-a14d1aa2d7d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:06.688466 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b692ab-32e4-4f81-87c0-a14d1aa2d7d5 service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:06.688758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b692ab-32e4-4f81-87c0-a14d1aa2d7d5 service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:06.689063 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b692ab-32e4-4f81-87c0-a14d1aa2d7d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:06.698548 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b692ab-32e4-4f81-87c0-a14d1aa2d7d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:06.700172 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b692ab-32e4-4f81-87c0-a14d1aa2d7d5 service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:06.710680 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 497/1004] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:08.999277 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba90aa2-a0ee-42f2-a3ce-fdeb2ac2efed None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:09.000198 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba90aa2-a0ee-42f2-a3ce-fdeb2ac2efed None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:09.000485 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba90aa2-a0ee-42f2-a3ce-fdeb2ac2efed None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:09.001851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 508/1005] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:09.007232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a7aa1-1d51-4674-aca8-9b8e3a499dc9 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:09.008956 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a7aa1-1d51-4674-aca8-9b8e3a499dc9 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:09.009333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a7aa1-1d51-4674-aca8-9b8e3a499dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:09.027998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-810a7aa1-1d51-4674-aca8-9b8e3a499dc9 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:09.029182 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-810a7aa1-1d51-4674-aca8-9b8e3a499dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:09.037180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 498/1006] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:53:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:09.081836 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba90aa2-a0ee-42f2-a3ce-fdeb2ac2efed None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:09.096429 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba90aa2-a0ee-42f2-a3ce-fdeb2ac2efed None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:09.102275 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231842ec-af37-4cc7-928d-483683ce4f5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:09.102906 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231842ec-af37-4cc7-928d-483683ce4f5b service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:09.103191 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231842ec-af37-4cc7-928d-483683ce4f5b service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:09.103468 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231842ec-af37-4cc7-928d-483683ce4f5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:09.112279 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231842ec-af37-4cc7-928d-483683ce4f5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:09.113866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231842ec-af37-4cc7-928d-483683ce4f5b service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:09.124086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 509/1007] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:11.935842 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a3cca-4d89-45cc-ab63-c4457009687d None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:11.936457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a3cca-4d89-45cc-ab63-c4457009687d None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:11.936564 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a3cca-4d89-45cc-ab63-c4457009687d None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:11.938169 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 499/1008] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:11.944535 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f3215-6ad1-4698-917f-a8a50f88353b None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:11.945715 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f3215-6ad1-4698-917f-a8a50f88353b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:11.946089 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f3215-6ad1-4698-917f-a8a50f88353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:11.968891 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-762f3215-6ad1-4698-917f-a8a50f88353b None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:11.970405 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-762f3215-6ad1-4698-917f-a8a50f88353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:11.980907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 510/1009] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:53:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:12.034174 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a3cca-4d89-45cc-ab63-c4457009687d None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:12.048399 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a3cca-4d89-45cc-ab63-c4457009687d None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:12.053417 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6241396-3e43-46eb-b9ae-177c0b8fe63f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:12.054046 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6241396-3e43-46eb-b9ae-177c0b8fe63f service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:12.055058 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6241396-3e43-46eb-b9ae-177c0b8fe63f service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:12.055491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6241396-3e43-46eb-b9ae-177c0b8fe63f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:12.063796 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6241396-3e43-46eb-b9ae-177c0b8fe63f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:12.065360 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6241396-3e43-46eb-b9ae-177c0b8fe63f service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:12.075617 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 500/1010] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:53:14.551650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0357-acc5-4d65-951d-9c65acd36d4c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:14.552316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0357-acc5-4d65-951d-9c65acd36d4c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:14.552422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0357-acc5-4d65-951d-9c65acd36d4c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:14.553821 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 511/1011] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:14.559670 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aaaeec-5572-4fcb-a576-a32787fb6fa5 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:14.560289 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aaaeec-5572-4fcb-a576-a32787fb6fa5 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:14.560289 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aaaeec-5572-4fcb-a576-a32787fb6fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:14.581525 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-b5aaaeec-5572-4fcb-a576-a32787fb6fa5 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:14.583133 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-b5aaaeec-5572-4fcb-a576-a32787fb6fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:14.594275 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 501/1012] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:53:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:53:14.641867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c0357-acc5-4d65-951d-9c65acd36d4c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:14.658104 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c0357-acc5-4d65-951d-9c65acd36d4c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:14.664437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95336f2-48a9-44bd-a6ea-5b3b1383d901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:14.665610 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95336f2-48a9-44bd-a6ea-5b3b1383d901 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:14.665980 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95336f2-48a9-44bd-a6ea-5b3b1383d901 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:14.666348 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95336f2-48a9-44bd-a6ea-5b3b1383d901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:14.676200 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95336f2-48a9-44bd-a6ea-5b3b1383d901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:14.678078 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95336f2-48a9-44bd-a6ea-5b3b1383d901 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:14.689814 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 512/1013] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:17.558329 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4823d-41a6-4278-af66-bbc77a335350 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:17.559033 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4823d-41a6-4278-af66-bbc77a335350 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:17.559033 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4823d-41a6-4278-af66-bbc77a335350 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:17.560244 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 502/1014] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:17.566063 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b9c40-2fd8-4966-8b66-e9d73abee9d5 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:17.566647 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b9c40-2fd8-4966-8b66-e9d73abee9d5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:17.566757 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b9c40-2fd8-4966-8b66-e9d73abee9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:17.573704 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=76 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:53:17.586481 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-945b9c40-2fd8-4966-8b66-e9d73abee9d5 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:17.587702 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-945b9c40-2fd8-4966-8b66-e9d73abee9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:17.595666 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 513/1015] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:53:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:17.643583 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4823d-41a6-4278-af66-bbc77a335350 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:17.652727 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:53:17.658028 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4823d-41a6-4278-af66-bbc77a335350 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:17.662960 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123b6cd-b40c-4103-8200-81784e4bdafd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:17.664311 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123b6cd-b40c-4103-8200-81784e4bdafd service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:17.664761 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123b6cd-b40c-4103-8200-81784e4bdafd service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:17.665050 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123b6cd-b40c-4103-8200-81784e4bdafd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:17.673455 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123b6cd-b40c-4103-8200-81784e4bdafd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:17.675047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123b6cd-b40c-4103-8200-81784e4bdafd service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:17.685390 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 503/1016] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:17.703309 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37f187-feca-40a7-8732-344fc9b30c66 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:17.703603 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37f187-feca-40a7-8732-344fc9b30c66 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:17.703909 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37f187-feca-40a7-8732-344fc9b30c66 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:17.705285 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 514/1017] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:17.712462 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dae598-8ab2-4740-b598-452feb14e46f None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:17.712767 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dae598-8ab2-4740-b598-452feb14e46f None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:17.713059 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dae598-8ab2-4740-b598-452feb14e46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:17.731535 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-60dae598-8ab2-4740-b598-452feb14e46f None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:17.733221 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-60dae598-8ab2-4740-b598-452feb14e46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:17.742657 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 504/1018] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:53:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:17.801265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0636e6-c5dd-4a5d-bb70-178b5db0dff1 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:17.801585 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0636e6-c5dd-4a5d-bb70-178b5db0dff1 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:17.801833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0636e6-c5dd-4a5d-bb70-178b5db0dff1 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:17.803240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 515/1019] 10.222.0.49 () {54 vars in 962 bytes} [Thu Jul 14 11:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:17.808749 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b67311-58b0-4568-bfff-1d0a2fd91a48 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:17.808957 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b67311-58b0-4568-bfff-1d0a2fd91a48 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:17.809319 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b67311-58b0-4568-bfff-1d0a2fd91a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:17.850037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-16b67311-58b0-4568-bfff-1d0a2fd91a48 None None] MFA Rules not processed for user `2ac098792b924ce887b3e3abfe596c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:17.851982 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-16b67311-58b0-4568-bfff-1d0a2fd91a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:17.917212 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 505/1020] 10.222.0.49 () {58 vars in 1059 bytes} [Thu Jul 14 11:53:17 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:53:17.924795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0636e6-c5dd-4a5d-bb70-178b5db0dff1 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:17.936218 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0636e6-c5dd-4a5d-bb70-178b5db0dff1 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:17.939598 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01da85a-b2c5-4cad-9ab7-9f9b25f54bfb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ac098792b924ce887b3e3abfe596c8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:17.940269 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01da85a-b2c5-4cad-9ab7-9f9b25f54bfb service glance] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:17.940553 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01da85a-b2c5-4cad-9ab7-9f9b25f54bfb service glance] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:17.940829 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01da85a-b2c5-4cad-9ab7-9f9b25f54bfb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:17.950690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01da85a-b2c5-4cad-9ab7-9f9b25f54bfb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:17.952147 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01da85a-b2c5-4cad-9ab7-9f9b25f54bfb service glance] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:17.961895 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 516/1021] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:20.028827 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c657b4-f3aa-4bce-9aef-cfff9e14ef39 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:20.029489 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c657b4-f3aa-4bce-9aef-cfff9e14ef39 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:20.029489 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c657b4-f3aa-4bce-9aef-cfff9e14ef39 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:20.030851 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 506/1022] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:20.036434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210460a-cb97-47b3-8be3-2d4a8761c1cd None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:20.036949 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210460a-cb97-47b3-8be3-2d4a8761c1cd None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:20.037047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210460a-cb97-47b3-8be3-2d4a8761c1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:20.055674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-8210460a-cb97-47b3-8be3-2d4a8761c1cd None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:20.056929 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8210460a-cb97-47b3-8be3-2d4a8761c1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:20.064975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 517/1023] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:53:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:20.111591 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c657b4-f3aa-4bce-9aef-cfff9e14ef39 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:20.130332 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c657b4-f3aa-4bce-9aef-cfff9e14ef39 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:20.135865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd1cf7-8c6f-4bb2-b08b-cf3e714a990a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:20.136557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd1cf7-8c6f-4bb2-b08b-cf3e714a990a service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:20.136842 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd1cf7-8c6f-4bb2-b08b-cf3e714a990a service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:20.137118 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd1cf7-8c6f-4bb2-b08b-cf3e714a990a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:20.148370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd1cf7-8c6f-4bb2-b08b-cf3e714a990a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:20.149976 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd1cf7-8c6f-4bb2-b08b-cf3e714a990a service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:20.161562 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 507/1024] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:30.049721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=11 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:53:30.155426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=46 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:53:33.353497 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993c8ce-3314-4954-9b19-f667b1c160fc None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:33.354089 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993c8ce-3314-4954-9b19-f667b1c160fc None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:33.354089 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993c8ce-3314-4954-9b19-f667b1c160fc None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:33.355460 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 518/1025] 10.222.0.49 () {54 vars in 918 bytes} [Thu Jul 14 11:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:33.360855 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda784a5-870e-4768-b5fb-b0f96583566b None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:33.361335 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda784a5-870e-4768-b5fb-b0f96583566b None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:33.361437 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda784a5-870e-4768-b5fb-b0f96583566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:33.380467 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-bda784a5-870e-4768-b5fb-b0f96583566b None None] MFA Rules not processed for user `de477915cf5e41e8a65a57e8b546997f`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:33.382736 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-bda784a5-870e-4768-b5fb-b0f96583566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:33.391515 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 508/1026] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Jul 14 11:53:33 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:53:33.406148 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a798e-cbe0-487f-860d-94b0e1369dc4 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:33.406439 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a798e-cbe0-487f-860d-94b0e1369dc4 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:33.406721 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a798e-cbe0-487f-860d-94b0e1369dc4 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:33.408112 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 519/1027] 10.222.0.49 () {54 vars in 918 bytes} [Thu Jul 14 11:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:33.412674 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbfd2b-e160-4a49-958e-c92bde004e11 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:33.412998 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbfd2b-e160-4a49-958e-c92bde004e11 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:33.413367 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbfd2b-e160-4a49-958e-c92bde004e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:33.431214 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-e3fbfd2b-e160-4a49-958e-c92bde004e11 None None] MFA Rules not processed for user `6fd8e197398e465aa3247d2ea89430d8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:33.432367 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-e3fbfd2b-e160-4a49-958e-c92bde004e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:33.440671 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 509/1028] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Jul 14 11:53:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:36.154576 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d08f82-876c-4a47-bfac-8be0d04af18e None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:36.155217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d08f82-876c-4a47-bfac-8be0d04af18e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:36.155217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d08f82-876c-4a47-bfac-8be0d04af18e None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:36.156537 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 520/1029] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:36.161743 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a38eb4-f54c-4a25-b1b7-738e840b0c95 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:36.162185 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a38eb4-f54c-4a25-b1b7-738e840b0c95 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:36.162310 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a38eb4-f54c-4a25-b1b7-738e840b0c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:36.181066 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-f2a38eb4-f54c-4a25-b1b7-738e840b0c95 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:36.182274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-f2a38eb4-f54c-4a25-b1b7-738e840b0c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:36.190327 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 510/1030] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:53:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:36.233913 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d08f82-876c-4a47-bfac-8be0d04af18e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:36.248249 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d08f82-876c-4a47-bfac-8be0d04af18e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:36.253020 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea4227-91e9-4f74-b3e8-a2fdb630b81f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:36.253648 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea4227-91e9-4f74-b3e8-a2fdb630b81f service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:36.253933 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea4227-91e9-4f74-b3e8-a2fdb630b81f service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:36.254206 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea4227-91e9-4f74-b3e8-a2fdb630b81f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:36.262167 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea4227-91e9-4f74-b3e8-a2fdb630b81f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:36.263741 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea4227-91e9-4f74-b3e8-a2fdb630b81f service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:36.273257 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 521/1031] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:37.226845 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad00a7b-ebf3-4b3e-8cba-bb3e1fc6082d None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:37.227330 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad00a7b-ebf3-4b3e-8cba-bb3e1fc6082d None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:37.227440 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad00a7b-ebf3-4b3e-8cba-bb3e1fc6082d None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:37.228806 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 511/1032] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:37.233864 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a652b-0cf6-4213-8424-5a1ef875b268 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:37.234291 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a652b-0cf6-4213-8424-5a1ef875b268 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:37.234435 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a652b-0cf6-4213-8424-5a1ef875b268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:37.254154 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-692a652b-0cf6-4213-8424-5a1ef875b268 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:37.255708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-692a652b-0cf6-4213-8424-5a1ef875b268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:37.264297 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 522/1033] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:53:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:37.512426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad00a7b-ebf3-4b3e-8cba-bb3e1fc6082d None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:37.525738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad00a7b-ebf3-4b3e-8cba-bb3e1fc6082d None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:37.530599 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12235c4b-8ea1-4404-a640-a2578a45aa3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:37.531259 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12235c4b-8ea1-4404-a640-a2578a45aa3b service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:37.531542 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12235c4b-8ea1-4404-a640-a2578a45aa3b service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:37.531822 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12235c4b-8ea1-4404-a640-a2578a45aa3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:37.540017 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12235c4b-8ea1-4404-a640-a2578a45aa3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:37.541594 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12235c4b-8ea1-4404-a640-a2578a45aa3b service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:37.550989 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 512/1034] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:38.474267 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb6e6a-2554-40ca-a50f-edf87b16bbfc None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:38.474798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb6e6a-2554-40ca-a50f-edf87b16bbfc None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:38.474798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb6e6a-2554-40ca-a50f-edf87b16bbfc None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:38.476713 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 523/1035] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:38.481447 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da262856-c5ac-418e-a266-568b0c1511dc None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:38.482154 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da262856-c5ac-418e-a266-568b0c1511dc None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:38.482264 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da262856-c5ac-418e-a266-568b0c1511dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:38.500147 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-da262856-c5ac-418e-a266-568b0c1511dc None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:38.501322 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-da262856-c5ac-418e-a266-568b0c1511dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:38.508965 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 513/1036] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:53:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:38.662238 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb6e6a-2554-40ca-a50f-edf87b16bbfc None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:38.675715 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb6e6a-2554-40ca-a50f-edf87b16bbfc None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:38.681167 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4b479-36b3-43d8-b95c-e196d9fcc404 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:38.681790 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4b479-36b3-43d8-b95c-e196d9fcc404 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:38.682074 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4b479-36b3-43d8-b95c-e196d9fcc404 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:38.682348 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4b479-36b3-43d8-b95c-e196d9fcc404 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:38.690179 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4b479-36b3-43d8-b95c-e196d9fcc404 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:38.691754 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4b479-36b3-43d8-b95c-e196d9fcc404 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:38.701025 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 524/1037] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:39.565651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6eb5bd-4f16-45e0-8071-24c74acb55dc None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:39.566169 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6eb5bd-4f16-45e0-8071-24c74acb55dc None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:39.566169 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6eb5bd-4f16-45e0-8071-24c74acb55dc None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:39.567540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 514/1038] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:39.573085 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94b669-9777-4352-a9a9-db7dbc288be2 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:39.573507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94b669-9777-4352-a9a9-db7dbc288be2 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:39.573646 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94b669-9777-4352-a9a9-db7dbc288be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:39.591119 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-4a94b669-9777-4352-a9a9-db7dbc288be2 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:39.592342 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4a94b669-9777-4352-a9a9-db7dbc288be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:39.599943 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 525/1039] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:53:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:39.755347 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6eb5bd-4f16-45e0-8071-24c74acb55dc None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:39.769400 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6eb5bd-4f16-45e0-8071-24c74acb55dc None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:39.774378 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234453c7-5be7-443b-a013-a8c53b28bb72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:39.775006 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234453c7-5be7-443b-a013-a8c53b28bb72 service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:39.775294 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234453c7-5be7-443b-a013-a8c53b28bb72 service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:39.775577 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234453c7-5be7-443b-a013-a8c53b28bb72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:39.783782 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234453c7-5be7-443b-a013-a8c53b28bb72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:39.785401 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234453c7-5be7-443b-a013-a8c53b28bb72 service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:39.794834 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 515/1040] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:40.657927 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a86c06-65aa-45c8-834c-42550f6f1527 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:40.658482 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a86c06-65aa-45c8-834c-42550f6f1527 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:40.658482 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a86c06-65aa-45c8-834c-42550f6f1527 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:40.659850 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 526/1041] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:40.664897 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005ab81-7781-4ebd-a40c-b51c89e26fdb None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:40.665327 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005ab81-7781-4ebd-a40c-b51c89e26fdb None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:40.665455 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005ab81-7781-4ebd-a40c-b51c89e26fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:40.683685 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-0005ab81-7781-4ebd-a40c-b51c89e26fdb None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:40.684913 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-0005ab81-7781-4ebd-a40c-b51c89e26fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:40.692551 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 516/1042] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:53:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:40.848327 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a86c06-65aa-45c8-834c-42550f6f1527 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:40.863130 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a86c06-65aa-45c8-834c-42550f6f1527 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:40.869337 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee6aa-7f2c-4a7d-bccd-f09eb8c2fff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:40.869979 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee6aa-7f2c-4a7d-bccd-f09eb8c2fff2 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:40.870264 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee6aa-7f2c-4a7d-bccd-f09eb8c2fff2 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:40.870541 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee6aa-7f2c-4a7d-bccd-f09eb8c2fff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:40.879241 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ee6aa-7f2c-4a7d-bccd-f09eb8c2fff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:40.880867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ee6aa-7f2c-4a7d-bccd-f09eb8c2fff2 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:40.892429 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 527/1043] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:41.718719 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad235f-72ff-465b-b3fc-ae0ac0b78e22 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:41.719259 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad235f-72ff-465b-b3fc-ae0ac0b78e22 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:41.719259 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad235f-72ff-465b-b3fc-ae0ac0b78e22 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:41.720776 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 517/1044] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:41.726130 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291feeca-0f05-4c86-b317-0c23b8833dd6 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:41.726553 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291feeca-0f05-4c86-b317-0c23b8833dd6 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:41.726784 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291feeca-0f05-4c86-b317-0c23b8833dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:41.745175 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-291feeca-0f05-4c86-b317-0c23b8833dd6 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:41.746373 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-291feeca-0f05-4c86-b317-0c23b8833dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:41.754073 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 528/1045] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:53:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:41.912362 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad235f-72ff-465b-b3fc-ae0ac0b78e22 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:41.926314 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad235f-72ff-465b-b3fc-ae0ac0b78e22 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:41.931388 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf480e5a-64f4-4e1b-bf83-3316f4b9b1e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:41.932049 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf480e5a-64f4-4e1b-bf83-3316f4b9b1e8 service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:41.932334 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf480e5a-64f4-4e1b-bf83-3316f4b9b1e8 service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:41.932636 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf480e5a-64f4-4e1b-bf83-3316f4b9b1e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:41.940723 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf480e5a-64f4-4e1b-bf83-3316f4b9b1e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:41.942290 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf480e5a-64f4-4e1b-bf83-3316f4b9b1e8 service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:41.952560 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 518/1046] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:42.765884 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947daa4-83d9-4749-ae96-3cde244c1c43 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:42.766431 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947daa4-83d9-4749-ae96-3cde244c1c43 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:42.766431 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947daa4-83d9-4749-ae96-3cde244c1c43 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:42.767827 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 529/1047] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:42.773230 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74906a73-7791-4eea-bf4e-b9872fba5df0 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:42.773668 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74906a73-7791-4eea-bf4e-b9872fba5df0 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:42.773793 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74906a73-7791-4eea-bf4e-b9872fba5df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:42.793266 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-74906a73-7791-4eea-bf4e-b9872fba5df0 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:42.794465 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-74906a73-7791-4eea-bf4e-b9872fba5df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:42.802179 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 519/1048] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:53:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:42.966427 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947daa4-83d9-4749-ae96-3cde244c1c43 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:42.980682 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947daa4-83d9-4749-ae96-3cde244c1c43 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:42.985861 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f2c37-f4fa-4c26-a9e6-54a0a5449258 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:42.986490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f2c37-f4fa-4c26-a9e6-54a0a5449258 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:42.986781 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f2c37-f4fa-4c26-a9e6-54a0a5449258 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:42.987063 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f2c37-f4fa-4c26-a9e6-54a0a5449258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:42.996222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f2c37-f4fa-4c26-a9e6-54a0a5449258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:42.997806 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f2c37-f4fa-4c26-a9e6-54a0a5449258 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:43.007460 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 530/1049] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:43.816750 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbc51e-a060-418c-a764-eaed3f6f9eb6 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:43.817293 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbc51e-a060-418c-a764-eaed3f6f9eb6 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:43.817293 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbc51e-a060-418c-a764-eaed3f6f9eb6 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:43.818659 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 520/1050] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:43.823618 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a688b9-0f03-4c2f-b433-2f775045a1e9 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:43.824070 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a688b9-0f03-4c2f-b433-2f775045a1e9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:43.824252 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a688b9-0f03-4c2f-b433-2f775045a1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:43.841994 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-90a688b9-0f03-4c2f-b433-2f775045a1e9 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:43.843194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-90a688b9-0f03-4c2f-b433-2f775045a1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:43.851359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 531/1051] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:53:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:44.008636 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbc51e-a060-418c-a764-eaed3f6f9eb6 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:44.021786 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbc51e-a060-418c-a764-eaed3f6f9eb6 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:44.026666 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf118a1d-340c-4eee-95ca-50e75c7b2263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:44.027294 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf118a1d-340c-4eee-95ca-50e75c7b2263 service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:44.027580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf118a1d-340c-4eee-95ca-50e75c7b2263 service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:44.027863 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf118a1d-340c-4eee-95ca-50e75c7b2263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:44.035780 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf118a1d-340c-4eee-95ca-50e75c7b2263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:44.037392 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf118a1d-340c-4eee-95ca-50e75c7b2263 service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:44.047397 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 521/1052] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:44.890401 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa26f6-07bb-4744-9d3e-1c94db163034 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:44.890984 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa26f6-07bb-4744-9d3e-1c94db163034 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:44.890984 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa26f6-07bb-4744-9d3e-1c94db163034 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:44.892516 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 532/1053] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:44.898937 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c352b6-0269-4bc4-80a4-da2b6c81101a None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:44.899470 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c352b6-0269-4bc4-80a4-da2b6c81101a None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:44.899971 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c352b6-0269-4bc4-80a4-da2b6c81101a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:44.922268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-10c352b6-0269-4bc4-80a4-da2b6c81101a None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:44.923511 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-10c352b6-0269-4bc4-80a4-da2b6c81101a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:44.931566 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 522/1054] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:53:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:45.083837 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa26f6-07bb-4744-9d3e-1c94db163034 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:45.097833 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa26f6-07bb-4744-9d3e-1c94db163034 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:45.103872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd8541-58e1-4deb-abb6-e78e18d8ecb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:45.104649 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd8541-58e1-4deb-abb6-e78e18d8ecb8 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:45.104933 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd8541-58e1-4deb-abb6-e78e18d8ecb8 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:45.105208 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd8541-58e1-4deb-abb6-e78e18d8ecb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:45.113475 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd8541-58e1-4deb-abb6-e78e18d8ecb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:45.115043 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd8541-58e1-4deb-abb6-e78e18d8ecb8 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:45.124260 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 533/1055] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:47.285973 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fd233-1293-4bb5-bd6d-ed0c83e713f3 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:47.286531 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fd233-1293-4bb5-bd6d-ed0c83e713f3 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:47.286531 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fd233-1293-4bb5-bd6d-ed0c83e713f3 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:47.288556 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 523/1056] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:47.293839 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3df800-99d8-4cc2-9a42-9e2cf9bf1fa0 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:47.294266 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3df800-99d8-4cc2-9a42-9e2cf9bf1fa0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:47.294387 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3df800-99d8-4cc2-9a42-9e2cf9bf1fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:47.311937 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-1b3df800-99d8-4cc2-9a42-9e2cf9bf1fa0 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:47.313128 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1b3df800-99d8-4cc2-9a42-9e2cf9bf1fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:47.320960 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 534/1057] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:53:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:47.361255 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fd233-1293-4bb5-bd6d-ed0c83e713f3 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:47.371864 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fd233-1293-4bb5-bd6d-ed0c83e713f3 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:47.375331 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486df0a1-942d-448c-8297-3598077d6314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:47.375991 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486df0a1-942d-448c-8297-3598077d6314 service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:47.376277 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486df0a1-942d-448c-8297-3598077d6314 service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:47.376557 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486df0a1-942d-448c-8297-3598077d6314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:47.385991 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486df0a1-942d-448c-8297-3598077d6314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:47.387422 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486df0a1-942d-448c-8297-3598077d6314 service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:47.396768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 524/1058] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:49.790998 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4319e9-a625-4652-9d40-613ff936b13c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:49.791575 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4319e9-a625-4652-9d40-613ff936b13c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:49.791575 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4319e9-a625-4652-9d40-613ff936b13c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:49.792954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 535/1059] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:49.798426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5cb52-7307-42aa-ae4d-9a62698dc5d1 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:49.798826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5cb52-7307-42aa-ae4d-9a62698dc5d1 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:49.798997 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5cb52-7307-42aa-ae4d-9a62698dc5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:49.817000 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-b1a5cb52-7307-42aa-ae4d-9a62698dc5d1 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:49.818207 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-b1a5cb52-7307-42aa-ae4d-9a62698dc5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:49.826934 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 525/1060] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:53:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:49.867377 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4319e9-a625-4652-9d40-613ff936b13c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:49.877832 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4319e9-a625-4652-9d40-613ff936b13c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:49.881775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b66da-788c-46dd-aed8-133b87cd9095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:49.882399 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b66da-788c-46dd-aed8-133b87cd9095 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:49.882677 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b66da-788c-46dd-aed8-133b87cd9095 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:49.882946 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b66da-788c-46dd-aed8-133b87cd9095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:49.891713 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b66da-788c-46dd-aed8-133b87cd9095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:49.893170 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b66da-788c-46dd-aed8-133b87cd9095 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:49.903085 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 536/1061] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:53:52.455272 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408043ff-44b5-4d1c-898a-ce62110c49a3 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:52.455823 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408043ff-44b5-4d1c-898a-ce62110c49a3 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:52.455823 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408043ff-44b5-4d1c-898a-ce62110c49a3 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:52.457192 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 526/1062] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:52.463107 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d433f-bbb3-4261-82ee-2de0d7cf4079 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:52.463564 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d433f-bbb3-4261-82ee-2de0d7cf4079 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:52.463691 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d433f-bbb3-4261-82ee-2de0d7cf4079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:52.481453 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-512d433f-bbb3-4261-82ee-2de0d7cf4079 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:52.482905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-512d433f-bbb3-4261-82ee-2de0d7cf4079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:52.490577 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 537/1063] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:53:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:52.529423 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408043ff-44b5-4d1c-898a-ce62110c49a3 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:52.541123 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408043ff-44b5-4d1c-898a-ce62110c49a3 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:52.545307 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb66747-91ec-47e1-a52b-c22ade66574f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:52.546328 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb66747-91ec-47e1-a52b-c22ade66574f service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:52.546831 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb66747-91ec-47e1-a52b-c22ade66574f service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:52.547347 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb66747-91ec-47e1-a52b-c22ade66574f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:52.557315 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb66747-91ec-47e1-a52b-c22ade66574f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:52.558741 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb66747-91ec-47e1-a52b-c22ade66574f service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:52.568033 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 527/1064] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:54.930958 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e946bd-f9d2-413c-b727-759cd47e1cb4 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:54.931536 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e946bd-f9d2-413c-b727-759cd47e1cb4 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:54.931536 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e946bd-f9d2-413c-b727-759cd47e1cb4 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:54.932945 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 538/1065] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:54.938156 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a92c79-b094-41e7-90b9-8341de6dabcb None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:54.938592 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a92c79-b094-41e7-90b9-8341de6dabcb None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:54.938698 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a92c79-b094-41e7-90b9-8341de6dabcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:54.957189 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-13a92c79-b094-41e7-90b9-8341de6dabcb None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:54.958372 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-13a92c79-b094-41e7-90b9-8341de6dabcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:54.966072 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 528/1066] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:53:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:55.005743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e946bd-f9d2-413c-b727-759cd47e1cb4 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:55.017374 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e946bd-f9d2-413c-b727-759cd47e1cb4 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:55.020867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aba28-a658-455a-be92-964364957fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:55.021507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aba28-a658-455a-be92-964364957fef service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:55.021853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aba28-a658-455a-be92-964364957fef service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:55.022678 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aba28-a658-455a-be92-964364957fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:55.031650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3aba28-a658-455a-be92-964364957fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:55.033133 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3aba28-a658-455a-be92-964364957fef service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:55.043436 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 539/1067] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:57.331798 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e4998-3fb9-41a8-b96a-0ebdb4d4be77 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:57.332404 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e4998-3fb9-41a8-b96a-0ebdb4d4be77 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:57.332404 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e4998-3fb9-41a8-b96a-0ebdb4d4be77 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:57.333744 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 529/1068] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:57.339021 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e30e3b-aaee-44cb-b873-0e051814d3c2 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:57.339444 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e30e3b-aaee-44cb-b873-0e051814d3c2 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:57.339595 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e30e3b-aaee-44cb-b873-0e051814d3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:57.357778 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-97e30e3b-aaee-44cb-b873-0e051814d3c2 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:57.358975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-97e30e3b-aaee-44cb-b873-0e051814d3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:57.367722 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 540/1069] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:53:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:57.407270 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e4998-3fb9-41a8-b96a-0ebdb4d4be77 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:57.418272 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e4998-3fb9-41a8-b96a-0ebdb4d4be77 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:57.421675 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23287f7-6dcf-4e79-b87a-8fc6c3bcdd08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:57.422299 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23287f7-6dcf-4e79-b87a-8fc6c3bcdd08 service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:57.422582 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23287f7-6dcf-4e79-b87a-8fc6c3bcdd08 service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:57.422859 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23287f7-6dcf-4e79-b87a-8fc6c3bcdd08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:57.432214 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23287f7-6dcf-4e79-b87a-8fc6c3bcdd08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:57.433636 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23287f7-6dcf-4e79-b87a-8fc6c3bcdd08 service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:57.442811 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 530/1070] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:53:59.823003 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7564f-5f85-4ef6-ad02-4b34583bba4e None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:59.823568 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7564f-5f85-4ef6-ad02-4b34583bba4e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:59.823674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7564f-5f85-4ef6-ad02-4b34583bba4e None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:59.825037 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 541/1071] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:53:59.830290 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2ca59-ffd9-41e1-b2c8-ddcc5475478e None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:59.830708 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2ca59-ffd9-41e1-b2c8-ddcc5475478e None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:59.830852 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2ca59-ffd9-41e1-b2c8-ddcc5475478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:59.848666 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-69e2ca59-ffd9-41e1-b2c8-ddcc5475478e None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:59.850446 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-69e2ca59-ffd9-41e1-b2c8-ddcc5475478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:59.858607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 531/1072] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:53:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:53:59.897224 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7564f-5f85-4ef6-ad02-4b34583bba4e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:59.907792 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7564f-5f85-4ef6-ad02-4b34583bba4e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:59.911272 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81144037-743c-4fe5-8303-6beaf359cd92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:59.911927 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81144037-743c-4fe5-8303-6beaf359cd92 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:59.912220 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81144037-743c-4fe5-8303-6beaf359cd92 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:59.913136 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81144037-743c-4fe5-8303-6beaf359cd92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:59.924040 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81144037-743c-4fe5-8303-6beaf359cd92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:59.925484 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81144037-743c-4fe5-8303-6beaf359cd92 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:59.936222 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 542/1073] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:53:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:54:02.259324 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03e997-6893-470f-a30d-cf88b5a4cefe None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:02.259848 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03e997-6893-470f-a30d-cf88b5a4cefe None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:02.259990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03e997-6893-470f-a30d-cf88b5a4cefe None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:02.261291 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 532/1074] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:02.266626 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5d4e0-ea72-41d4-9234-d828741e9b4c None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:02.267023 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5d4e0-ea72-41d4-9234-d828741e9b4c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:02.267196 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5d4e0-ea72-41d4-9234-d828741e9b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:02.273900 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=70 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:02.287407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c6c5d4e0-ea72-41d4-9234-d828741e9b4c None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:02.288648 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c6c5d4e0-ea72-41d4-9234-d828741e9b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:02.296472 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 543/1075] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:54:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:54:02.335919 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03e997-6893-470f-a30d-cf88b5a4cefe None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:02.341295 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=73 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:02.347502 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03e997-6893-470f-a30d-cf88b5a4cefe None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:02.351705 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645b2ad-ed73-49d3-96c1-b85588110605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:02.352367 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645b2ad-ed73-49d3-96c1-b85588110605 service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:02.352666 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645b2ad-ed73-49d3-96c1-b85588110605 service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:02.352933 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645b2ad-ed73-49d3-96c1-b85588110605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:02.362128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645b2ad-ed73-49d3-96c1-b85588110605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:02.363556 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645b2ad-ed73-49d3-96c1-b85588110605 service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:02.373048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 533/1076] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:54:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:54:04.661920 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058c4c8-9a3a-40e0-8d5c-3ff80d93139c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:04.663139 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058c4c8-9a3a-40e0-8d5c-3ff80d93139c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:04.663244 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058c4c8-9a3a-40e0-8d5c-3ff80d93139c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:04.664804 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 544/1077] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:04.669984 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c56f98-720a-4df1-a8b5-30cf8a7b2503 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:04.670428 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c56f98-720a-4df1-a8b5-30cf8a7b2503 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:04.670533 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c56f98-720a-4df1-a8b5-30cf8a7b2503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:04.687809 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-61c56f98-720a-4df1-a8b5-30cf8a7b2503 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:04.689024 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-61c56f98-720a-4df1-a8b5-30cf8a7b2503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:04.697082 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 534/1078] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:54:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:54:04.734995 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058c4c8-9a3a-40e0-8d5c-3ff80d93139c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:04.746250 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058c4c8-9a3a-40e0-8d5c-3ff80d93139c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:04.749753 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad3ec3-1432-4e4c-ac49-2aba77a9d3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:04.750384 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad3ec3-1432-4e4c-ac49-2aba77a9d3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:04.750672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad3ec3-1432-4e4c-ac49-2aba77a9d3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:04.750954 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad3ec3-1432-4e4c-ac49-2aba77a9d3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:04.760961 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad3ec3-1432-4e4c-ac49-2aba77a9d3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:04.762398 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad3ec3-1432-4e4c-ac49-2aba77a9d3d5 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:04.772402 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 545/1079] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:54:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:54:06.993077 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4944a92-f81c-4b11-a855-6a301f61287e None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:06.993651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4944a92-f81c-4b11-a855-6a301f61287e None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:06.993651 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4944a92-f81c-4b11-a855-6a301f61287e None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:06.994986 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 535/1080] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:07.000262 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75554674-5ce5-40e4-9c33-113e78f39993 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:07.000697 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75554674-5ce5-40e4-9c33-113e78f39993 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:07.000827 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75554674-5ce5-40e4-9c33-113e78f39993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:07.018774 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-75554674-5ce5-40e4-9c33-113e78f39993 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:07.020017 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-75554674-5ce5-40e4-9c33-113e78f39993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:07.028505 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 546/1081] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:54:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:54:07.067447 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4944a92-f81c-4b11-a855-6a301f61287e None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:07.078095 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4944a92-f81c-4b11-a855-6a301f61287e None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:07.081600 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5feaf-e368-4bfa-b09c-735f810bf7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:07.082232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5feaf-e368-4bfa-b09c-735f810bf7df service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:07.082520 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5feaf-e368-4bfa-b09c-735f810bf7df service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:07.082798 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5feaf-e368-4bfa-b09c-735f810bf7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:07.091622 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5feaf-e368-4bfa-b09c-735f810bf7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:07.093106 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5feaf-e368-4bfa-b09c-735f810bf7df service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:07.102836 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 536/1082] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:54:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:54:09.340509 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004a578-0c01-45ee-b957-fa4aa6a6c17b None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:09.341072 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004a578-0c01-45ee-b957-fa4aa6a6c17b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:09.341179 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004a578-0c01-45ee-b957-fa4aa6a6c17b None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:09.342479 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 547/1083] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:09.347728 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6f49f-feda-4dec-8274-28f9ba47a7eb None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:09.348215 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6f49f-feda-4dec-8274-28f9ba47a7eb None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:09.348318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6f49f-feda-4dec-8274-28f9ba47a7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:09.367041 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-19b6f49f-feda-4dec-8274-28f9ba47a7eb None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:09.368278 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-19b6f49f-feda-4dec-8274-28f9ba47a7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:09.375963 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 537/1084] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:54:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:54:09.414355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004a578-0c01-45ee-b957-fa4aa6a6c17b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:09.424847 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004a578-0c01-45ee-b957-fa4aa6a6c17b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:09.429342 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4693ece-3774-4039-aa40-94e2338a1002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:09.429919 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4693ece-3774-4039-aa40-94e2338a1002 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:09.430208 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4693ece-3774-4039-aa40-94e2338a1002 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:09.430490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4693ece-3774-4039-aa40-94e2338a1002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:09.439800 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4693ece-3774-4039-aa40-94e2338a1002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:09.441251 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4693ece-3774-4039-aa40-94e2338a1002 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:09.450708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 548/1085] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:54:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:54:19.361426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=17 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:19.446672 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=17 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:33.380158 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952275f-065e-4545-8ae1-4c5073dd116b None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:33.380782 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952275f-065e-4545-8ae1-4c5073dd116b None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:33.380782 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952275f-065e-4545-8ae1-4c5073dd116b None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:33.382267 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 538/1086] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:33.387540 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b0557-5775-4f00-9634-a6ba07b75d17 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:33.388001 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b0557-5775-4f00-9634-a6ba07b75d17 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:33.388142 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b0557-5775-4f00-9634-a6ba07b75d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:33.406116 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-526b0557-5775-4f00-9634-a6ba07b75d17 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:33.407306 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-526b0557-5775-4f00-9634-a6ba07b75d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:33.415579 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 549/1087] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:54:33.469745 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c23329-46a1-425c-964d-1c15b70f3f8e None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:33.470037 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c23329-46a1-425c-964d-1c15b70f3f8e None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:33.470321 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c23329-46a1-425c-964d-1c15b70f3f8e None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:33.471719 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 539/1088] 10.222.0.49 () {54 vars in 962 bytes} [Thu Jul 14 11:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:33.478107 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789193dc-99eb-4c11-b3db-f7d468abcd82 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:33.478395 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789193dc-99eb-4c11-b3db-f7d468abcd82 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:33.478676 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789193dc-99eb-4c11-b3db-f7d468abcd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:33.497535 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-789193dc-99eb-4c11-b3db-f7d468abcd82 None None] MFA Rules not processed for user `2ac098792b924ce887b3e3abfe596c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:33.498907 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-789193dc-99eb-4c11-b3db-f7d468abcd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:33.506162 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 550/1089] 10.222.0.49 () {58 vars in 1059 bytes} [Thu Jul 14 11:54:33 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:54:33.513535 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c23329-46a1-425c-964d-1c15b70f3f8e None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:33.524724 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c23329-46a1-425c-964d-1c15b70f3f8e None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:33.528183 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bed12-5266-49c6-ae2f-432cb414cfb9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ac098792b924ce887b3e3abfe596c8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:33.528812 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bed12-5266-49c6-ae2f-432cb414cfb9 service glance] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:33.529098 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bed12-5266-49c6-ae2f-432cb414cfb9 service glance] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:33.529377 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bed12-5266-49c6-ae2f-432cb414cfb9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:33.538883 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bed12-5266-49c6-ae2f-432cb414cfb9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:33.540427 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bed12-5266-49c6-ae2f-432cb414cfb9 service glance] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:33.549597 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 540/1090] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:54:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:54:35.928872 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025444d-bca4-40b5-bb22-e58ca13734c3 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:35.929495 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025444d-bca4-40b5-bb22-e58ca13734c3 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:35.929495 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025444d-bca4-40b5-bb22-e58ca13734c3 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:35.931115 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 551/1091] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:35.936672 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff5596-1447-4967-8feb-ba9dcbc30d9b None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:35.937121 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff5596-1447-4967-8feb-ba9dcbc30d9b None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:35.937226 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff5596-1447-4967-8feb-ba9dcbc30d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:35.955001 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-5eff5596-1447-4967-8feb-ba9dcbc30d9b None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:35.956209 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-5eff5596-1447-4967-8feb-ba9dcbc30d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:35.963819 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 541/1092] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:54:35.989291 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025444d-bca4-40b5-bb22-e58ca13734c3 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:36.002352 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025444d-bca4-40b5-bb22-e58ca13734c3 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:36.006893 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735582b-5411-44f1-9b0d-99c259ebdfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:36.007528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735582b-5411-44f1-9b0d-99c259ebdfcd admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:36.007817 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735582b-5411-44f1-9b0d-99c259ebdfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:36.008132 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735582b-5411-44f1-9b0d-99c259ebdfcd admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:36.008862 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735582b-5411-44f1-9b0d-99c259ebdfcd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:36.010607 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: WARNING py.warnings [None req-6735582b-5411-44f1-9b0d-99c259ebdfcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:54:36.010607 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: warnings.warn(msg) Jul 14 11:54:36.010607 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: Jul 14 11:54:36.011769 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735582b-5411-44f1-9b0d-99c259ebdfcd admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:36.030499 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 552/1093] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:35 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:54:38.302982 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b13f5-575a-48be-997c-58be1b24b996 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:38.303461 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b13f5-575a-48be-997c-58be1b24b996 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:38.303565 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b13f5-575a-48be-997c-58be1b24b996 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:38.304999 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 542/1094] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:54:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:38.310158 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c66407-a085-4343-872c-7f89a707f446 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:38.310596 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c66407-a085-4343-872c-7f89a707f446 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:38.310756 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c66407-a085-4343-872c-7f89a707f446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:38.329700 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-17c66407-a085-4343-872c-7f89a707f446 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:38.330923 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-17c66407-a085-4343-872c-7f89a707f446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:38.339388 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 553/1095] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:54:38.383837 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b13f5-575a-48be-997c-58be1b24b996 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:38.398425 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b13f5-575a-48be-997c-58be1b24b996 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:38.402891 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5de20-a400-4826-8482-389716eeb87f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:38.403522 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5de20-a400-4826-8482-389716eeb87f service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:38.403808 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5de20-a400-4826-8482-389716eeb87f service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:38.404120 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5de20-a400-4826-8482-389716eeb87f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:38.412281 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5de20-a400-4826-8482-389716eeb87f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:38.413917 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5de20-a400-4826-8482-389716eeb87f service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:38.423408 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 543/1096] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:54:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:54:40.838956 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130d073-dbf3-4a85-a700-0d4c084a5c00 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:40.839470 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130d073-dbf3-4a85-a700-0d4c084a5c00 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:40.839470 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130d073-dbf3-4a85-a700-0d4c084a5c00 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:40.840876 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 554/1097] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:40.845928 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945402ed-c649-4713-a8e6-21fa58fcb8ea None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:40.846321 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945402ed-c649-4713-a8e6-21fa58fcb8ea None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:40.846484 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945402ed-c649-4713-a8e6-21fa58fcb8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:40.864656 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-945402ed-c649-4713-a8e6-21fa58fcb8ea None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:40.865873 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-945402ed-c649-4713-a8e6-21fa58fcb8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:40.874533 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 544/1098] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:54:40.911465 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130d073-dbf3-4a85-a700-0d4c084a5c00 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:40.922921 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130d073-dbf3-4a85-a700-0d4c084a5c00 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:40.926332 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb29f7-6186-4821-bd6e-f6032be84c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:40.926958 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb29f7-6186-4821-bd6e-f6032be84c69 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:40.927282 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb29f7-6186-4821-bd6e-f6032be84c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:40.927759 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb29f7-6186-4821-bd6e-f6032be84c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:40.936638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb29f7-6186-4821-bd6e-f6032be84c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:40.938064 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb29f7-6186-4821-bd6e-f6032be84c69 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:40.947418 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 555/1099] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:54:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:54:43.253656 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dfaa5-9fe7-46e7-95eb-d95b3eee2cb2 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:43.254204 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dfaa5-9fe7-46e7-95eb-d95b3eee2cb2 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:43.254204 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dfaa5-9fe7-46e7-95eb-d95b3eee2cb2 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:43.256278 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 545/1100] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:43.261610 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cb078-5274-43f5-94c2-61ec3dc2a169 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:43.262041 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cb078-5274-43f5-94c2-61ec3dc2a169 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:43.262171 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cb078-5274-43f5-94c2-61ec3dc2a169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:43.279492 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c22cb078-5274-43f5-94c2-61ec3dc2a169 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:43.280762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c22cb078-5274-43f5-94c2-61ec3dc2a169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:43.288415 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 556/1101] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:54:43.326999 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dfaa5-9fe7-46e7-95eb-d95b3eee2cb2 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:43.339031 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dfaa5-9fe7-46e7-95eb-d95b3eee2cb2 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:43.342879 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be94bf-1b67-40e0-886b-e8cb027bd83b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:43.343529 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be94bf-1b67-40e0-886b-e8cb027bd83b service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:43.343816 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be94bf-1b67-40e0-886b-e8cb027bd83b service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:43.344129 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be94bf-1b67-40e0-886b-e8cb027bd83b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:43.353401 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be94bf-1b67-40e0-886b-e8cb027bd83b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:43.355069 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be94bf-1b67-40e0-886b-e8cb027bd83b service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:43.364755 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 546/1102] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:54:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:54:45.709928 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358bea5-6305-4f0a-b281-18c1f8554085 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:45.710507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358bea5-6305-4f0a-b281-18c1f8554085 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:45.710507 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358bea5-6305-4f0a-b281-18c1f8554085 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:45.711877 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 557/1103] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:45.717120 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d892c88-9a05-4424-9ee5-4e4f41b41945 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:45.717543 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d892c88-9a05-4424-9ee5-4e4f41b41945 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:45.717679 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d892c88-9a05-4424-9ee5-4e4f41b41945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:45.736032 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-9d892c88-9a05-4424-9ee5-4e4f41b41945 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:45.737234 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-9d892c88-9a05-4424-9ee5-4e4f41b41945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:45.745611 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 547/1104] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:54:45.803494 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c445a54-61b1-4f7f-bbc3-5b088ff2dbd8 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:45.803777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c445a54-61b1-4f7f-bbc3-5b088ff2dbd8 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:45.804086 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c445a54-61b1-4f7f-bbc3-5b088ff2dbd8 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:45.805466 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 558/1105] 10.222.0.49 () {54 vars in 964 bytes} [Thu Jul 14 11:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:45.811662 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d5277-40bf-46d1-9474-30756c9944ff None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:45.811980 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d5277-40bf-46d1-9474-30756c9944ff None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:45.812262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d5277-40bf-46d1-9474-30756c9944ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:45.829955 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-8a7d5277-40bf-46d1-9474-30756c9944ff None None] MFA Rules not processed for user `336c852c9dfb4c6a8ee62134c2ff32ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:45.831158 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-8a7d5277-40bf-46d1-9474-30756c9944ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:45.838173 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 548/1106] 10.222.0.49 () {58 vars in 1061 bytes} [Thu Jul 14 11:54:45 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:54:45.846945 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c445a54-61b1-4f7f-bbc3-5b088ff2dbd8 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:45.858871 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c445a54-61b1-4f7f-bbc3-5b088ff2dbd8 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:45.862380 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adabc7-a57e-44e8-8db4-fa6d9f27b3f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:45.863009 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adabc7-a57e-44e8-8db4-fa6d9f27b3f7 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:45.863299 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adabc7-a57e-44e8-8db4-fa6d9f27b3f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:45.863582 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adabc7-a57e-44e8-8db4-fa6d9f27b3f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:45.873436 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adabc7-a57e-44e8-8db4-fa6d9f27b3f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:45.874857 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adabc7-a57e-44e8-8db4-fa6d9f27b3f7 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:45.885110 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 559/1107] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:54:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:54:48.783535 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138e9bf-6818-4189-9d07-eee31c95f25c None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:48.784274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138e9bf-6818-4189-9d07-eee31c95f25c None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:48.784274 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138e9bf-6818-4189-9d07-eee31c95f25c None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:48.786932 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 549/1108] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 14 11:54:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:48.793762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122e290-d0d5-42ca-8869-dbfa3fc53a5d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:48.794271 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122e290-d0d5-42ca-8869-dbfa3fc53a5d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:48.794673 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122e290-d0d5-42ca-8869-dbfa3fc53a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:48.814646 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c122e290-d0d5-42ca-8869-dbfa3fc53a5d None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:48.815766 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c122e290-d0d5-42ca-8869-dbfa3fc53a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:48.823538 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 560/1109] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:54:48.865571 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138e9bf-6818-4189-9d07-eee31c95f25c None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:48.876229 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138e9bf-6818-4189-9d07-eee31c95f25c None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:48.879943 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0b6d3-4c3d-45f5-aebd-844b15c9fad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:48.880767 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0b6d3-4c3d-45f5-aebd-844b15c9fad4 service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:48.881049 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0b6d3-4c3d-45f5-aebd-844b15c9fad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:48.881323 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0b6d3-4c3d-45f5-aebd-844b15c9fad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:48.889975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0b6d3-4c3d-45f5-aebd-844b15c9fad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:48.891400 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0b6d3-4c3d-45f5-aebd-844b15c9fad4 service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:48.900707 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 550/1110] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:54:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:54:58.809623 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=33 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:58.896688 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=36 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:17.732811 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd4aff-911c-4e08-bc63-9cbb7027a4bd None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.733438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd4aff-911c-4e08-bc63-9cbb7027a4bd None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.733438 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd4aff-911c-4e08-bc63-9cbb7027a4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:17.750782 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-8acd4aff-911c-4e08-bc63-9cbb7027a4bd None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:17.752006 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8acd4aff-911c-4e08-bc63-9cbb7027a4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:17.759711 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 561/1111] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 11:56:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:56:17.767623 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcea041-281b-43ce-a982-a21878eb8be6 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.768182 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcea041-281b-43ce-a982-a21878eb8be6 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.768296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcea041-281b-43ce-a982-a21878eb8be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:17.787141 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-ffcea041-281b-43ce-a982-a21878eb8be6 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:17.788387 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-ffcea041-281b-43ce-a982-a21878eb8be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:17.796279 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 551/1112] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 11:56:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:56:17.800731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd4aff-911c-4e08-bc63-9cbb7027a4bd None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:17.810095 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd4aff-911c-4e08-bc63-9cbb7027a4bd None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:17.814601 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfd1d8-58cf-4c63-a5ea-993ddb3fdd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:17.815237 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfd1d8-58cf-4c63-a5ea-993ddb3fdd0e admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.815517 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfd1d8-58cf-4c63-a5ea-993ddb3fdd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.815790 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfd1d8-58cf-4c63-a5ea-993ddb3fdd0e admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:17.817176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfd1d8-58cf-4c63-a5ea-993ddb3fdd0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:17.817489 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfd1d8-58cf-4c63-a5ea-993ddb3fdd0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:17.818512 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: WARNING py.warnings [None req-7dbfd1d8-58cf-4c63-a5ea-993ddb3fdd0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:56:17.818512 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: warnings.warn(msg) Jul 14 11:56:17.818512 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: Jul 14 11:56:17.819405 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfd1d8-58cf-4c63-a5ea-993ddb3fdd0e admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:17.830922 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 562/1113] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 14 11:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:17.839660 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcea041-281b-43ce-a982-a21878eb8be6 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:17.848919 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcea041-281b-43ce-a982-a21878eb8be6 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:17.853486 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e057c-b955-4266-95b0-e251a6a15245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:17.854411 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e057c-b955-4266-95b0-e251a6a15245 admin admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.854705 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e057c-b955-4266-95b0-e251a6a15245 admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.854988 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e057c-b955-4266-95b0-e251a6a15245 admin admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:17.855951 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e057c-b955-4266-95b0-e251a6a15245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:17.857779 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: WARNING py.warnings [None req-063e057c-b955-4266-95b0-e251a6a15245 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:56:17.857779 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: warnings.warn(msg) Jul 14 11:56:17.857779 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: Jul 14 11:56:17.859015 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e057c-b955-4266-95b0-e251a6a15245 admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:17.885922 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 552/1114] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 14 11:56:17 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:56:17.890019 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfd1d8-58cf-4c63-a5ea-993ddb3fdd0e admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:17.900476 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfd1d8-58cf-4c63-a5ea-993ddb3fdd0e admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:17.955870 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06137622-a0c7-4d70-8936-0a29bb5c873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:17.956554 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06137622-a0c7-4d70-8936-0a29bb5c873f admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.957407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06137622-a0c7-4d70-8936-0a29bb5c873f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.957691 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06137622-a0c7-4d70-8936-0a29bb5c873f admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:17.958370 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06137622-a0c7-4d70-8936-0a29bb5c873f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:17.959379 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: WARNING py.warnings [None req-06137622-a0c7-4d70-8936-0a29bb5c873f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:56:17.959379 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: warnings.warn(msg) Jul 14 11:56:17.959379 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: Jul 14 11:56:17.960609 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06137622-a0c7-4d70-8936-0a29bb5c873f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:17.979337 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 563/1115] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 14 11:56:17 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:56:17.983882 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e057c-b955-4266-95b0-e251a6a15245 admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:17.993959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e057c-b955-4266-95b0-e251a6a15245 admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:17.998505 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541654de-fb09-49f0-83ab-2e46e8e4d2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:17.999157 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541654de-fb09-49f0-83ab-2e46e8e4d2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.999442 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541654de-fb09-49f0-83ab-2e46e8e4d2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.999714 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541654de-fb09-49f0-83ab-2e46e8e4d2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:18.000467 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541654de-fb09-49f0-83ab-2e46e8e4d2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:18.001480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: WARNING py.warnings [None req-541654de-fb09-49f0-83ab-2e46e8e4d2b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:56:18.001480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: warnings.warn(msg) Jul 14 11:56:18.001480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: Jul 14 11:56:18.002355 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541654de-fb09-49f0-83ab-2e46e8e4d2b6 admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:18.015742 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 553/1116] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 14 11:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:56:18.020148 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06137622-a0c7-4d70-8936-0a29bb5c873f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:18.029667 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06137622-a0c7-4d70-8936-0a29bb5c873f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:18.034161 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23706c-b4df-4dc1-8f85-c868ed67049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:18.034802 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23706c-b4df-4dc1-8f85-c868ed67049c admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:18.035255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23706c-b4df-4dc1-8f85-c868ed67049c admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:18.035757 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23706c-b4df-4dc1-8f85-c868ed67049c admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:18.036506 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23706c-b4df-4dc1-8f85-c868ed67049c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:18.037505 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: WARNING py.warnings [None req-ca23706c-b4df-4dc1-8f85-c868ed67049c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:56:18.037505 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: warnings.warn(msg) Jul 14 11:56:18.037505 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: Jul 14 11:56:18.038378 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23706c-b4df-4dc1-8f85-c868ed67049c admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:18.051415 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 564/1117] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 14 11:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:56:18.055488 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541654de-fb09-49f0-83ab-2e46e8e4d2b6 admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:18.065273 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541654de-fb09-49f0-83ab-2e46e8e4d2b6 admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:18.070418 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91405890-c7af-4931-a912-3d7d8bd254a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:18.071282 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91405890-c7af-4931-a912-3d7d8bd254a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:18.071565 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91405890-c7af-4931-a912-3d7d8bd254a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:18.071841 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91405890-c7af-4931-a912-3d7d8bd254a4 admin admin] PATH_INFO: `/v3/projects/1eb450b990d448169682589fbc961add/users/b0ab9298e393464a9a415c032f509fa9/roles/7b517960be1c437d850537c7e0aa985a` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:18.086738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91405890-c7af-4931-a912-3d7d8bd254a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb450b990d448169682589fbc961add, user_id=b0ab9298e393464a9a415c032f509fa9, role_id=7b517960be1c437d850537c7e0aa985a)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:18.087776 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: WARNING py.warnings [None req-91405890-c7af-4931-a912-3d7d8bd254a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:56:18.087776 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: warnings.warn(msg) Jul 14 11:56:18.087776 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: Jul 14 11:56:18.089765 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91405890-c7af-4931-a912-3d7d8bd254a4 admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:18.103191 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 554/1118] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 14 11:56:18 2022] PUT /identity/v3/projects/1eb450b990d448169682589fbc961add/users/b0ab9298e393464a9a415c032f509fa9/roles/7b517960be1c437d850537c7e0aa985a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:56:18.115838 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b17f5-1b1a-42ee-9b2d-bbd3ca0e35da None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:18.116156 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b17f5-1b1a-42ee-9b2d-bbd3ca0e35da None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:18.116463 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b17f5-1b1a-42ee-9b2d-bbd3ca0e35da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:18.142255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-669b17f5-1b1a-42ee-9b2d-bbd3ca0e35da None None] MFA Rules not processed for user `b0ab9298e393464a9a415c032f509fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:18.143443 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-669b17f5-1b1a-42ee-9b2d-bbd3ca0e35da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:18.207076 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 565/1119] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 11:56:18 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:56:18.220507 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9e0bc-5936-45d6-a292-d7189adde9e7 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:18.220798 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9e0bc-5936-45d6-a292-d7189adde9e7 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:18.221079 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9e0bc-5936-45d6-a292-d7189adde9e7 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:18.222472 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 555/1120] 10.222.0.49 () {54 vars in 963 bytes} [Thu Jul 14 11:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:18.227492 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca27e70-9d6b-48f8-b796-702649ae42e2 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:18.227818 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca27e70-9d6b-48f8-b796-702649ae42e2 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:18.228122 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca27e70-9d6b-48f8-b796-702649ae42e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:18.246660 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0ca27e70-9d6b-48f8-b796-702649ae42e2 None None] MFA Rules not processed for user `ab858f5998b348ecbac54423716b7671`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:18.247793 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0ca27e70-9d6b-48f8-b796-702649ae42e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:18.290313 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:18.298708 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 566/1121] 10.222.0.49 () {58 vars in 1060 bytes} [Thu Jul 14 11:56:18 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:56:18.306751 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9e0bc-5936-45d6-a292-d7189adde9e7 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:18.317906 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9e0bc-5936-45d6-a292-d7189adde9e7 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:18.321365 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed55a1-b501-4b3e-84f5-070bf7bfc2d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab858f5998b348ecbac54423716b7671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:18.322027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed55a1-b501-4b3e-84f5-070bf7bfc2d4 service cinder] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:18.322314 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed55a1-b501-4b3e-84f5-070bf7bfc2d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:18.323046 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed55a1-b501-4b3e-84f5-070bf7bfc2d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:18.330993 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed55a1-b501-4b3e-84f5-070bf7bfc2d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:18.332581 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed55a1-b501-4b3e-84f5-070bf7bfc2d4 service cinder] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:18.341191 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 556/1122] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:56:18 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:56:18.378140 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04c354-0c9a-4722-b827-2cae3d5365ea None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:18.378432 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04c354-0c9a-4722-b827-2cae3d5365ea None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:18.379372 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04c354-0c9a-4722-b827-2cae3d5365ea None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:18.380714 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 567/1123] 10.222.0.49 () {52 vars in 829 bytes} [Thu Jul 14 11:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:18.384185 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed55a1-b501-4b3e-84f5-070bf7bfc2d4 service cinder] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:18.446136 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed55a1-b501-4b3e-84f5-070bf7bfc2d4 service cinder] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:18.450650 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098dd215-15b3-48a8-ac87-f1ffbc550b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:18.451511 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dd215-15b3-48a8-ac87-f1ffbc550b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:18.451799 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dd215-15b3-48a8-ac87-f1ffbc550b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:18.452109 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dd215-15b3-48a8-ac87-f1ffbc550b7b admin admin] PATH_INFO: `/v3/users/b0ab9298e393464a9a415c032f509fa9` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:18.453295 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098dd215-15b3-48a8-ac87-f1ffbc550b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ab9298e393464a9a415c032f509fa9)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:18.454312 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: WARNING py.warnings [None req-098dd215-15b3-48a8-ac87-f1ffbc550b7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:56:18.454312 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: warnings.warn(msg) Jul 14 11:56:18.454312 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: Jul 14 11:56:18.455515 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098dd215-15b3-48a8-ac87-f1ffbc550b7b admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:18.520959 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-098dd215-15b3-48a8-ac87-f1ffbc550b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ab9298e393464a9a415c032f509fa9'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:56:18.539558 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-098dd215-15b3-48a8-ac87-f1ffbc550b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ab9298e393464a9a415c032f509fa9'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:56:18.540238 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-098dd215-15b3-48a8-ac87-f1ffbc550b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ab9298e393464a9a415c032f509fa9'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:56:18.540971 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-098dd215-15b3-48a8-ac87-f1ffbc550b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ab9298e393464a9a415c032f509fa9'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:56:18.551205 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-098dd215-15b3-48a8-ac87-f1ffbc550b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ab9298e393464a9a415c032f509fa9'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:56:18.570833 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 557/1124] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 14 11:56:18 2022] DELETE /identity/v3/users/b0ab9298e393464a9a415c032f509fa9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:56:18.575280 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1a6da-73b9-4b37-952e-70aeb23b04e7 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:18.575579 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1a6da-73b9-4b37-952e-70aeb23b04e7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:18.575869 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1a6da-73b9-4b37-952e-70aeb23b04e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:18.593709 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-d3d1a6da-73b9-4b37-952e-70aeb23b04e7 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:18.594949 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d3d1a6da-73b9-4b37-952e-70aeb23b04e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:18.653208 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 568/1125] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 11:56:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:56:18.662908 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098dd215-15b3-48a8-ac87-f1ffbc550b7b admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:18.665222 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-098dd215-15b3-48a8-ac87-f1ffbc550b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:18.672036 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:18.726093 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098dd215-15b3-48a8-ac87-f1ffbc550b7b admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:18.729689 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aeab0-9163-4649-8cc7-bdd0c91b7ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:18.730336 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aeab0-9163-4649-8cc7-bdd0c91b7ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:18.730874 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aeab0-9163-4649-8cc7-bdd0c91b7ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:18.731155 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aeab0-9163-4649-8cc7-bdd0c91b7ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:18.740051 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9aeab0-9163-4649-8cc7-bdd0c91b7ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:18.741480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9aeab0-9163-4649-8cc7-bdd0c91b7ff1 service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:18.750658 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 558/1126] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:56:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:56:19.102277 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1a6da-73b9-4b37-952e-70aeb23b04e7 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:19.103764 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d3d1a6da-73b9-4b37-952e-70aeb23b04e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:19.116180 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1a6da-73b9-4b37-952e-70aeb23b04e7 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:19.120955 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabacfb7-f675-423b-bea3-1ebabfaba35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:19.121879 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabacfb7-f675-423b-bea3-1ebabfaba35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:19.122613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabacfb7-f675-423b-bea3-1ebabfaba35e admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:19.122613 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabacfb7-f675-423b-bea3-1ebabfaba35e admin admin] PATH_INFO: `/v3/projects/1eb450b990d448169682589fbc961add` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:19.123626 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabacfb7-f675-423b-bea3-1ebabfaba35e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb450b990d448169682589fbc961add)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:19.124668 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: WARNING py.warnings [None req-dabacfb7-f675-423b-bea3-1ebabfaba35e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:56:19.124668 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: warnings.warn(msg) Jul 14 11:56:19.124668 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: Jul 14 11:56:19.125859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabacfb7-f675-423b-bea3-1ebabfaba35e admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:19.192170 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dabacfb7-f675-423b-bea3-1ebabfaba35e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb450b990d448169682589fbc961add', 'request_id': 'req-dabacfb7-f675-423b-bea3-1ebabfaba35e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:56:19.206807 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dabacfb7-f675-423b-bea3-1ebabfaba35e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb450b990d448169682589fbc961add', 'request_id': 'req-dabacfb7-f675-423b-bea3-1ebabfaba35e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:56:19.213022 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dabacfb7-f675-423b-bea3-1ebabfaba35e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb450b990d448169682589fbc961add', 'request_id': 'req-dabacfb7-f675-423b-bea3-1ebabfaba35e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:56:19.227422 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dabacfb7-f675-423b-bea3-1ebabfaba35e admin admin] The token cache is being invalidate because project 1eb450b990d448169682589fbc961add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:56:19.227716 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dabacfb7-f675-423b-bea3-1ebabfaba35e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:56:19.228477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dabacfb7-f675-423b-bea3-1ebabfaba35e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:56:19.230372 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 569/1127] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 14 11:56:19 2022] DELETE /identity/v3/projects/1eb450b990d448169682589fbc961add => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:56:28.746624 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=25 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:29.224375 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:43.142269 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408c8f0-a60f-40a6-bb34-bd26fb026b6e None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:43.142851 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408c8f0-a60f-40a6-bb34-bd26fb026b6e None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:43.142851 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408c8f0-a60f-40a6-bb34-bd26fb026b6e None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:43.144290 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 559/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:57:43.148988 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032920e-54ef-4e11-a1e7-63bae6e96d4c None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:43.149397 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032920e-54ef-4e11-a1e7-63bae6e96d4c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:43.149561 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032920e-54ef-4e11-a1e7-63bae6e96d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:43.219518 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-f032920e-54ef-4e11-a1e7-63bae6e96d4c None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:57:43.220782 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f032920e-54ef-4e11-a1e7-63bae6e96d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:57:43.313231 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 570/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:57:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:57:43.473383 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408c8f0-a60f-40a6-bb34-bd26fb026b6e None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:43.475056 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-e408c8f0-a60f-40a6-bb34-bd26fb026b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:57:43.563146 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408c8f0-a60f-40a6-bb34-bd26fb026b6e None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:43.568121 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2f05e-2442-4aed-a679-a7473283a5d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:43.568766 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2f05e-2442-4aed-a679-a7473283a5d1 service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:43.569054 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2f05e-2442-4aed-a679-a7473283a5d1 service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:43.569337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2f05e-2442-4aed-a679-a7473283a5d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:43.577988 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2f05e-2442-4aed-a679-a7473283a5d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:43.579588 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2f05e-2442-4aed-a679-a7473283a5d1 service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:43.589082 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 560/1130] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:57:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:57:44.447140 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8fca6-3caf-4772-ad6e-18989b45f97c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:44.447874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8fca6-3caf-4772-ad6e-18989b45f97c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:44.447874 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8fca6-3caf-4772-ad6e-18989b45f97c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:44.449057 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 571/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:57:44.453823 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68049bd-3b5b-401b-ae38-8b586f85ce61 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:44.454262 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68049bd-3b5b-401b-ae38-8b586f85ce61 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:44.454373 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68049bd-3b5b-401b-ae38-8b586f85ce61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:44.472793 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-c68049bd-3b5b-401b-ae38-8b586f85ce61 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:57:44.474002 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-c68049bd-3b5b-401b-ae38-8b586f85ce61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:57:44.483048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 561/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:57:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:57:44.640843 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8fca6-3caf-4772-ad6e-18989b45f97c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:44.654580 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8fca6-3caf-4772-ad6e-18989b45f97c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:44.659529 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e44f00-239e-416a-af06-3fb4a58d1c59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:44.660209 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e44f00-239e-416a-af06-3fb4a58d1c59 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:44.660499 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e44f00-239e-416a-af06-3fb4a58d1c59 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:44.660785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e44f00-239e-416a-af06-3fb4a58d1c59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:44.669323 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e44f00-239e-416a-af06-3fb4a58d1c59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:44.670917 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e44f00-239e-416a-af06-3fb4a58d1c59 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:44.680235 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 572/1133] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:57:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:57:48.691256 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4b422-eee2-4695-85ac-190d4de7ece9 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:48.691772 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4b422-eee2-4695-85ac-190d4de7ece9 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:48.691772 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4b422-eee2-4695-85ac-190d4de7ece9 None None] PATH_INFO: `/v3` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:48.693087 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 562/1134] 10.222.0.30 () {54 vars in 925 bytes} [Thu Jul 14 11:57:48 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:57:48.699227 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7eabf7-cfed-430f-93aa-11cd1d827e6d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:48.699675 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7eabf7-cfed-430f-93aa-11cd1d827e6d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:48.699786 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7eabf7-cfed-430f-93aa-11cd1d827e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:48.727178 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-6e7eabf7-cfed-430f-93aa-11cd1d827e6d None None] MFA Rules not processed for user `de477915cf5e41e8a65a57e8b546997f`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:57:48.728404 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6e7eabf7-cfed-430f-93aa-11cd1d827e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:57:48.780695 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:48.790013 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 573/1135] 10.222.0.30 () {58 vars in 1015 bytes} [Thu Jul 14 11:57:48 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:57:54.468157 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=42 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:55.930985 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a2d84-1114-42b0-9c66-fbb62a4e57d1 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:55.931751 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a2d84-1114-42b0-9c66-fbb62a4e57d1 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:55.931751 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a2d84-1114-42b0-9c66-fbb62a4e57d1 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:55.933554 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 563/1136] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:57:55.938404 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc5880-86da-499c-b041-c44e8b35a774 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:55.938859 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc5880-86da-499c-b041-c44e8b35a774 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:55.938989 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc5880-86da-499c-b041-c44e8b35a774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:55.958484 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-7acc5880-86da-499c-b041-c44e8b35a774 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:57:55.959678 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7acc5880-86da-499c-b041-c44e8b35a774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:57:55.967537 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 574/1137] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:57:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:57:56.126123 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a2d84-1114-42b0-9c66-fbb62a4e57d1 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:56.139677 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a2d84-1114-42b0-9c66-fbb62a4e57d1 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:56.144658 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb474e-c547-4010-ba71-b3f12badb87e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:56.145282 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb474e-c547-4010-ba71-b3f12badb87e service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:56.145571 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb474e-c547-4010-ba71-b3f12badb87e service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:56.145854 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb474e-c547-4010-ba71-b3f12badb87e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:56.153907 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb474e-c547-4010-ba71-b3f12badb87e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:56.155522 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb474e-c547-4010-ba71-b3f12badb87e service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:56.164832 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 564/1138] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:57:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:57:56.988763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb138-53f2-470c-bafe-8cbdee002ecb None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:56.989329 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb138-53f2-470c-bafe-8cbdee002ecb None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:56.989329 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb138-53f2-470c-bafe-8cbdee002ecb None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:56.990722 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 575/1139] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:57:56.995832 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2369ff-de51-49ea-8e0f-452db33dfe29 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:56.996271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2369ff-de51-49ea-8e0f-452db33dfe29 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:56.996499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2369ff-de51-49ea-8e0f-452db33dfe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:57.014960 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-2e2369ff-de51-49ea-8e0f-452db33dfe29 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:57:57.016232 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-2e2369ff-de51-49ea-8e0f-452db33dfe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:57:57.024048 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 565/1140] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:57:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:57:57.179037 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb138-53f2-470c-bafe-8cbdee002ecb None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:57.196696 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb138-53f2-470c-bafe-8cbdee002ecb None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:57.202867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f761a00-22d9-4c13-a922-cf66b3e517dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:57.203513 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f761a00-22d9-4c13-a922-cf66b3e517dc service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:57.203793 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f761a00-22d9-4c13-a922-cf66b3e517dc service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:57.204109 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f761a00-22d9-4c13-a922-cf66b3e517dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:57.213278 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f761a00-22d9-4c13-a922-cf66b3e517dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:57.215176 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f761a00-22d9-4c13-a922-cf66b3e517dc service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:57.224908 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 576/1141] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:57:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:57:57.547655 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8981fd8-0810-4228-b097-22ae8b93f974 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:57.547862 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8981fd8-0810-4228-b097-22ae8b93f974 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:57.548156 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8981fd8-0810-4228-b097-22ae8b93f974 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:57.549510 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 566/1142] 10.222.0.49 () {54 vars in 960 bytes} [Thu Jul 14 11:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:57:57.554883 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97978808-987a-4061-a050-ab967c6439a9 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:57.555182 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97978808-987a-4061-a050-ab967c6439a9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:57.555467 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97978808-987a-4061-a050-ab967c6439a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:57.574246 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-97978808-987a-4061-a050-ab967c6439a9 None None] MFA Rules not processed for user `de477915cf5e41e8a65a57e8b546997f`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:57:57.575450 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-97978808-987a-4061-a050-ab967c6439a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:57:57.583852 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 577/1143] 10.222.0.49 () {58 vars in 1057 bytes} [Thu Jul 14 11:57:57 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:57:57.591278 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8981fd8-0810-4228-b097-22ae8b93f974 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:57.604311 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8981fd8-0810-4228-b097-22ae8b93f974 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:57.610145 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b5293-4810-40e5-8ee7-5595095dcca5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de477915cf5e41e8a65a57e8b546997f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:57.610775 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b5293-4810-40e5-8ee7-5595095dcca5 service placement] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:57.611065 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b5293-4810-40e5-8ee7-5595095dcca5 service placement] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:57.611348 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b5293-4810-40e5-8ee7-5595095dcca5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:57.619486 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b5293-4810-40e5-8ee7-5595095dcca5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:57.621845 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b5293-4810-40e5-8ee7-5595095dcca5 service placement] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:57.631495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 567/1144] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:57:57 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:58:01.562692 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f147d2-ed4f-4ea2-8741-2b0d06e06e55 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:01.563266 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f147d2-ed4f-4ea2-8741-2b0d06e06e55 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:01.563266 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f147d2-ed4f-4ea2-8741-2b0d06e06e55 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:01.564608 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 578/1145] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:58:01.569922 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce9731-1dc9-4275-9989-c727f914d38d None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:01.570482 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce9731-1dc9-4275-9989-c727f914d38d None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:01.570482 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce9731-1dc9-4275-9989-c727f914d38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:01.587906 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-e5ce9731-1dc9-4275-9989-c727f914d38d None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:58:01.589719 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-e5ce9731-1dc9-4275-9989-c727f914d38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:01.597396 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 568/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:58:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:58:01.635277 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f147d2-ed4f-4ea2-8741-2b0d06e06e55 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:01.637128 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-70f147d2-ed4f-4ea2-8741-2b0d06e06e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:01.693502 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f147d2-ed4f-4ea2-8741-2b0d06e06e55 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:01.696913 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e532b-208f-4c1f-b565-4f83ddc29598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:01.697548 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e532b-208f-4c1f-b565-4f83ddc29598 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:01.697831 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e532b-208f-4c1f-b565-4f83ddc29598 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:01.698108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e532b-208f-4c1f-b565-4f83ddc29598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:01.707173 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e532b-208f-4c1f-b565-4f83ddc29598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:01.708625 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e532b-208f-4c1f-b565-4f83ddc29598 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:01.718244 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 579/1147] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:58:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:58:03.962743 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859f08f-1926-448a-8f16-13425b9c7897 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:03.963331 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859f08f-1926-448a-8f16-13425b9c7897 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:03.963450 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859f08f-1926-448a-8f16-13425b9c7897 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:03.965305 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 569/1148] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:58:03.970557 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f52f4-698a-44ba-95e6-04dee603d2a4 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:03.970972 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f52f4-698a-44ba-95e6-04dee603d2a4 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:03.971125 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f52f4-698a-44ba-95e6-04dee603d2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:03.989626 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-2e8f52f4-698a-44ba-95e6-04dee603d2a4 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:58:03.990819 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-2e8f52f4-698a-44ba-95e6-04dee603d2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:03.998526 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 580/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:58:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:58:04.035416 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859f08f-1926-448a-8f16-13425b9c7897 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:04.037083 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-7859f08f-1926-448a-8f16-13425b9c7897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:04.050623 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859f08f-1926-448a-8f16-13425b9c7897 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:04.054199 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1bba2-c641-4c40-82f0-7f987390de8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:04.054825 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1bba2-c641-4c40-82f0-7f987390de8a service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:04.055110 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1bba2-c641-4c40-82f0-7f987390de8a service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:04.055391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1bba2-c641-4c40-82f0-7f987390de8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:04.064350 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1bba2-c641-4c40-82f0-7f987390de8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:04.065768 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1bba2-c641-4c40-82f0-7f987390de8a service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:04.075762 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 570/1150] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:58:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:58:07.830355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d5d85-d8f9-4684-8691-7b283efd3f81 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:07.830932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d5d85-d8f9-4684-8691-7b283efd3f81 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:07.830932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d5d85-d8f9-4684-8691-7b283efd3f81 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:07.832340 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 581/1151] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:58:07.839496 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6227a-bac0-44d6-828f-320c8ad55279 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:07.839994 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6227a-bac0-44d6-828f-320c8ad55279 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:07.840176 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6227a-bac0-44d6-828f-320c8ad55279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:07.858121 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-f0c6227a-bac0-44d6-828f-320c8ad55279 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:58:07.859314 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-f0c6227a-bac0-44d6-828f-320c8ad55279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:07.867041 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 571/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:58:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:58:08.146926 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d5d85-d8f9-4684-8691-7b283efd3f81 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:08.148621 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-2b1d5d85-d8f9-4684-8691-7b283efd3f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:08.207337 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d5d85-d8f9-4684-8691-7b283efd3f81 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:08.210810 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9232c-e6d3-431d-bc03-8e3ad699c4ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab858f5998b348ecbac54423716b7671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:08.211465 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9232c-e6d3-431d-bc03-8e3ad699c4ad service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:08.211750 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9232c-e6d3-431d-bc03-8e3ad699c4ad service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:08.212066 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9232c-e6d3-431d-bc03-8e3ad699c4ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:08.221150 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9232c-e6d3-431d-bc03-8e3ad699c4ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:08.222587 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9232c-e6d3-431d-bc03-8e3ad699c4ad service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:08.232254 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 582/1153] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:58:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:58:10.514416 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d86e3-4221-43c3-8aac-114cff29c71d None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:10.515003 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d86e3-4221-43c3-8aac-114cff29c71d None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:10.515003 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d86e3-4221-43c3-8aac-114cff29c71d None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:10.516306 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 572/1154] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:58:10.521355 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0937d-00c5-42d4-94ee-8334e9c636de None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:10.521793 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0937d-00c5-42d4-94ee-8334e9c636de None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:10.521902 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0937d-00c5-42d4-94ee-8334e9c636de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:10.539677 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-dbb0937d-00c5-42d4-94ee-8334e9c636de None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:58:10.540910 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-dbb0937d-00c5-42d4-94ee-8334e9c636de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:10.548707 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 583/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:58:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:58:10.816907 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d86e3-4221-43c3-8aac-114cff29c71d None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:10.818547 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-e13d86e3-4221-43c3-8aac-114cff29c71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:10.831729 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d86e3-4221-43c3-8aac-114cff29c71d None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:10.835144 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31c0f7-fe8a-48e8-838a-c2ae4876e918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab858f5998b348ecbac54423716b7671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:10.835775 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31c0f7-fe8a-48e8-838a-c2ae4876e918 service cinder] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:10.836089 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31c0f7-fe8a-48e8-838a-c2ae4876e918 service cinder] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:10.836372 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31c0f7-fe8a-48e8-838a-c2ae4876e918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:10.845300 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31c0f7-fe8a-48e8-838a-c2ae4876e918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:10.846725 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31c0f7-fe8a-48e8-838a-c2ae4876e918 service cinder] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:10.856641 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 573/1156] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:58:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:58:20.534668 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=70 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:20.851865 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=33 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:29.824771 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4e16f-ca4c-4216-8bb4-a77b03808acf None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:29.825413 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4e16f-ca4c-4216-8bb4-a77b03808acf None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:29.825413 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4e16f-ca4c-4216-8bb4-a77b03808acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:29.844045 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-65a4e16f-ca4c-4216-8bb4-a77b03808acf None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:29.845241 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-65a4e16f-ca4c-4216-8bb4-a77b03808acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:29.849394 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e716e-b133-46a7-aeb3-1e56d09ea080 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:29.849887 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e716e-b133-46a7-aeb3-1e56d09ea080 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:29.850001 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e716e-b133-46a7-aeb3-1e56d09ea080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:29.852996 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 584/1157] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 11:59:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:59:29.861116 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2248bb-c66f-4e56-a2c2-8adb282dd058 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:29.861408 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2248bb-c66f-4e56-a2c2-8adb282dd058 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:29.861691 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2248bb-c66f-4e56-a2c2-8adb282dd058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:29.869046 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-eb4e716e-b133-46a7-aeb3-1e56d09ea080 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:29.870328 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-eb4e716e-b133-46a7-aeb3-1e56d09ea080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:29.878459 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 574/1158] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 11:59:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:59:29.878996 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-8a2248bb-c66f-4e56-a2c2-8adb282dd058 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:29.880202 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8a2248bb-c66f-4e56-a2c2-8adb282dd058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:29.887692 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47e7e-5957-48e0-b49c-d71906056ed4 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:29.888047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47e7e-5957-48e0-b49c-d71906056ed4 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:29.888337 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47e7e-5957-48e0-b49c-d71906056ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:29.888786 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 585/1159] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 11:59:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:59:29.892746 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2248bb-c66f-4e56-a2c2-8adb282dd058 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:29.902690 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2248bb-c66f-4e56-a2c2-8adb282dd058 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:29.906477 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-7fc47e7e-5957-48e0-b49c-d71906056ed4 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:29.907242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5eb08-7815-4da4-a6e8-d49c3a9e68e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:29.907679 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-7fc47e7e-5957-48e0-b49c-d71906056ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:29.907877 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5eb08-7815-4da4-a6e8-d49c3a9e68e6 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:29.908328 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5eb08-7815-4da4-a6e8-d49c3a9e68e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:29.908605 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5eb08-7815-4da4-a6e8-d49c3a9e68e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:29.909319 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5eb08-7815-4da4-a6e8-d49c3a9e68e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:59:29.909629 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5eb08-7815-4da4-a6e8-d49c3a9e68e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:29.911217 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5eb08-7815-4da4-a6e8-d49c3a9e68e6 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:29.915962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 575/1160] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 11:59:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:59:29.920819 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc47e7e-5957-48e0-b49c-d71906056ed4 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:29.932766 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 586/1161] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 14 11:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:59:29.932940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc47e7e-5957-48e0-b49c-d71906056ed4 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:29.934092 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5eb08-7815-4da4-a6e8-d49c3a9e68e6 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:29.935198 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4543594-62d5-4ac1-b2f1-079f586367cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:29.936030 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4543594-62d5-4ac1-b2f1-079f586367cd admin admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:29.936319 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4543594-62d5-4ac1-b2f1-079f586367cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:29.936597 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4543594-62d5-4ac1-b2f1-079f586367cd admin admin] PATH_INFO: `/v3/domains` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:29.937316 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4543594-62d5-4ac1-b2f1-079f586367cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:59:29.937623 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4543594-62d5-4ac1-b2f1-079f586367cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:29.938642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: WARNING py.warnings [None req-d4543594-62d5-4ac1-b2f1-079f586367cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:59:29.938642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: warnings.warn(msg) Jul 14 11:59:29.938642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: Jul 14 11:59:29.939541 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4543594-62d5-4ac1-b2f1-079f586367cd admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:29.943683 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5eb08-7815-4da4-a6e8-d49c3a9e68e6 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:29.949075 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44061441-aa0a-4c08-b7f5-bf2fb58d4fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:29.949704 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44061441-aa0a-4c08-b7f5-bf2fb58d4fbc admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:29.949987 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44061441-aa0a-4c08-b7f5-bf2fb58d4fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:29.950261 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44061441-aa0a-4c08-b7f5-bf2fb58d4fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:29.950932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44061441-aa0a-4c08-b7f5-bf2fb58d4fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:29.951958 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: WARNING py.warnings [None req-44061441-aa0a-4c08-b7f5-bf2fb58d4fbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:59:29.951958 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: warnings.warn(msg) Jul 14 11:59:29.951958 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: Jul 14 11:59:29.952520 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 576/1162] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 14 11:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:59:29.953151 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44061441-aa0a-4c08-b7f5-bf2fb58d4fbc admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:29.960379 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4543594-62d5-4ac1-b2f1-079f586367cd admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:29.970002 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4543594-62d5-4ac1-b2f1-079f586367cd admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:29.974711 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23a75a-e0e7-423c-bcf8-85d0060777e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:29.975374 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23a75a-e0e7-423c-bcf8-85d0060777e5 admin admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:29.975781 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23a75a-e0e7-423c-bcf8-85d0060777e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:29.976056 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23a75a-e0e7-423c-bcf8-85d0060777e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:29.976980 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23a75a-e0e7-423c-bcf8-85d0060777e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:29.979096 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23a75a-e0e7-423c-bcf8-85d0060777e5 admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:29.990171 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 587/1163] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 14 11:59:29 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:59:29.995241 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44061441-aa0a-4c08-b7f5-bf2fb58d4fbc admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:30.010858 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 577/1164] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 14 11:59:29 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:59:30.011940 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23a75a-e0e7-423c-bcf8-85d0060777e5 admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:30.063104 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44061441-aa0a-4c08-b7f5-bf2fb58d4fbc admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:30.074226 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23a75a-e0e7-423c-bcf8-85d0060777e5 admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:30.078924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f61bb7-4ca0-4273-b0bd-5e9cb0d5c74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:30.079560 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f61bb7-4ca0-4273-b0bd-5e9cb0d5c74b admin admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:30.080000 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f61bb7-4ca0-4273-b0bd-5e9cb0d5c74b admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:30.080285 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f61bb7-4ca0-4273-b0bd-5e9cb0d5c74b admin admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:30.080975 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f61bb7-4ca0-4273-b0bd-5e9cb0d5c74b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:30.081983 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: WARNING py.warnings [None req-22f61bb7-4ca0-4273-b0bd-5e9cb0d5c74b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:59:30.081983 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: warnings.warn(msg) Jul 14 11:59:30.081983 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: Jul 14 11:59:30.083199 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f61bb7-4ca0-4273-b0bd-5e9cb0d5c74b admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:30.105357 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 578/1165] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 14 11:59:30 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:59:30.109359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f61bb7-4ca0-4273-b0bd-5e9cb0d5c74b admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:30.118605 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f61bb7-4ca0-4273-b0bd-5e9cb0d5c74b admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:30.122180 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cd67a-244d-4f07-a675-8ce5ff0d053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:30.122854 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cd67a-244d-4f07-a675-8ce5ff0d053d admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:30.123107 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0523d5c-e456-40f6-831a-bb4006c982a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:30.123233 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cd67a-244d-4f07-a675-8ce5ff0d053d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:30.123407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cd67a-244d-4f07-a675-8ce5ff0d053d admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:30.123776 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0523d5c-e456-40f6-831a-bb4006c982a6 admin admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:30.124094 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0523d5c-e456-40f6-831a-bb4006c982a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:30.124201 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cd67a-244d-4f07-a675-8ce5ff0d053d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:30.124376 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0523d5c-e456-40f6-831a-bb4006c982a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:30.125090 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0523d5c-e456-40f6-831a-bb4006c982a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:30.126039 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cd67a-244d-4f07-a675-8ce5ff0d053d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:30.126679 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0523d5c-e456-40f6-831a-bb4006c982a6 admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:30.137925 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 579/1166] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 14 11:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:59:30.141818 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0523d5c-e456-40f6-831a-bb4006c982a6 admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:30.150121 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 588/1167] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 14 11:59:29 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:59:30.150851 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cd67a-244d-4f07-a675-8ce5ff0d053d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:30.151658 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0523d5c-e456-40f6-831a-bb4006c982a6 admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:30.156523 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b198265-d858-4d9f-8230-9c687a765f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:30.157170 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b198265-d858-4d9f-8230-9c687a765f03 admin admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:30.157448 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b198265-d858-4d9f-8230-9c687a765f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:30.157724 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b198265-d858-4d9f-8230-9c687a765f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:30.158517 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b198265-d858-4d9f-8230-9c687a765f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:30.160872 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b198265-d858-4d9f-8230-9c687a765f03 admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:30.162126 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cd67a-244d-4f07-a675-8ce5ff0d053d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:30.166829 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af69db-7b00-4e7b-a0e8-0026dedde824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:30.167486 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af69db-7b00-4e7b-a0e8-0026dedde824 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:30.167774 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af69db-7b00-4e7b-a0e8-0026dedde824 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:30.168161 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af69db-7b00-4e7b-a0e8-0026dedde824 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:30.168880 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af69db-7b00-4e7b-a0e8-0026dedde824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:30.170463 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af69db-7b00-4e7b-a0e8-0026dedde824 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:30.171013 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 580/1168] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 14 11:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:59:30.175145 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b198265-d858-4d9f-8230-9c687a765f03 admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:30.185271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b198265-d858-4d9f-8230-9c687a765f03 admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:30.190020 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 589/1169] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 14 11:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:59:30.190178 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83161655-5d96-4cd2-95c3-d377a6439d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:30.190905 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83161655-5d96-4cd2-95c3-d377a6439d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:30.191190 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83161655-5d96-4cd2-95c3-d377a6439d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:30.191470 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83161655-5d96-4cd2-95c3-d377a6439d49 admin admin] PATH_INFO: `/v3/projects/bb1444554c6b4fc7a3b3b497be241120/users/7fddb99331e44f22bb65fa2ca0d4850d/roles/7b517960be1c437d850537c7e0aa985a` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:30.192865 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af69db-7b00-4e7b-a0e8-0026dedde824 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:30.202814 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af69db-7b00-4e7b-a0e8-0026dedde824 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:30.207429 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381e3c2-d9f4-469f-ac24-c4ebb52ef038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:30.207595 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83161655-5d96-4cd2-95c3-d377a6439d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1444554c6b4fc7a3b3b497be241120, user_id=7fddb99331e44f22bb65fa2ca0d4850d, role_id=7b517960be1c437d850537c7e0aa985a)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:30.208108 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381e3c2-d9f4-469f-ac24-c4ebb52ef038 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:30.208398 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381e3c2-d9f4-469f-ac24-c4ebb52ef038 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:30.208678 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381e3c2-d9f4-469f-ac24-c4ebb52ef038 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:30.209387 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381e3c2-d9f4-469f-ac24-c4ebb52ef038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:30.210294 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83161655-5d96-4cd2-95c3-d377a6439d49 admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:30.210956 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381e3c2-d9f4-469f-ac24-c4ebb52ef038 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:30.222289 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 590/1170] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 14 11:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:59:30.224758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 581/1171] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 14 11:59:30 2022] PUT /identity/v3/projects/bb1444554c6b4fc7a3b3b497be241120/users/7fddb99331e44f22bb65fa2ca0d4850d/roles/7b517960be1c437d850537c7e0aa985a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:59:30.226474 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381e3c2-d9f4-469f-ac24-c4ebb52ef038 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:30.229817 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6541515-0751-4725-b751-a96cd3f92147 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:30.230109 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6541515-0751-4725-b751-a96cd3f92147 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:30.230388 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6541515-0751-4725-b751-a96cd3f92147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:30.236487 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381e3c2-d9f4-469f-ac24-c4ebb52ef038 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:30.247066 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-a6541515-0751-4725-b751-a96cd3f92147 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:30.248298 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-a6541515-0751-4725-b751-a96cd3f92147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:30.248960 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:30.296368 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0c36c-a94e-4d24-a254-b4aafcd16bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:30.297589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0c36c-a94e-4d24-a254-b4aafcd16bba admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:30.297934 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0c36c-a94e-4d24-a254-b4aafcd16bba admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:30.298211 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0c36c-a94e-4d24-a254-b4aafcd16bba admin admin] PATH_INFO: `/v3/projects/c0a6362bd479483b9cffee149bb623d7/users/52a1e134c830490d9469e62dec14fffe/roles/7b517960be1c437d850537c7e0aa985a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:30.298528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:30.314219 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0c36c-a94e-4d24-a254-b4aafcd16bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a6362bd479483b9cffee149bb623d7, user_id=52a1e134c830490d9469e62dec14fffe, role_id=7b517960be1c437d850537c7e0aa985a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:30.315270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: WARNING py.warnings [None req-c4c0c36c-a94e-4d24-a254-b4aafcd16bba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:59:30.315270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: warnings.warn(msg) Jul 14 11:59:30.315270 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: Jul 14 11:59:30.315561 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 582/1172] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 11:59:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:59:30.317554 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0c36c-a94e-4d24-a254-b4aafcd16bba admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:30.326928 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6541515-0751-4725-b751-a96cd3f92147 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:30.334258 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 591/1173] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 14 11:59:30 2022] PUT /identity/v3/projects/c0a6362bd479483b9cffee149bb623d7/users/52a1e134c830490d9469e62dec14fffe/roles/7b517960be1c437d850537c7e0aa985a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:59:30.341483 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b82de-6464-4b89-9709-35156e5ea694 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:30.341868 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b82de-6464-4b89-9709-35156e5ea694 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:30.342178 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b82de-6464-4b89-9709-35156e5ea694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:30.364763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-d02b82de-6464-4b89-9709-35156e5ea694 None None] MFA Rules not processed for user `e96f467bcdaf40f288963da3024186a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:30.365989 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d02b82de-6464-4b89-9709-35156e5ea694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:30.389394 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6541515-0751-4725-b751-a96cd3f92147 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:30.428815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 592/1174] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 11:59:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:59:30.441327 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b82de-6464-4b89-9709-35156e5ea694 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:30.443840 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cf3a4-3e7d-439a-8d4c-e915cf41d274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:30.444522 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cf3a4-3e7d-439a-8d4c-e915cf41d274 service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:30.444804 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cf3a4-3e7d-439a-8d4c-e915cf41d274 service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:30.445078 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cf3a4-3e7d-439a-8d4c-e915cf41d274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:30.455215 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cf3a4-3e7d-439a-8d4c-e915cf41d274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:30.455480 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b82de-6464-4b89-9709-35156e5ea694 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:30.456769 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cf3a4-3e7d-439a-8d4c-e915cf41d274 service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:30.459881 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c436e6-cbdc-43af-b61f-75de1ffbe2df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:30.461067 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c436e6-cbdc-43af-b61f-75de1ffbe2df service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:30.461936 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c436e6-cbdc-43af-b61f-75de1ffbe2df service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:30.461936 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c436e6-cbdc-43af-b61f-75de1ffbe2df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:30.468047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 583/1175] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:59:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:59:30.473578 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c436e6-cbdc-43af-b61f-75de1ffbe2df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:30.476364 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c436e6-cbdc-43af-b61f-75de1ffbe2df service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:30.490063 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 593/1176] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:59:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:59:35.652014 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c9325-b2d5-4471-b370-b98453c22c9a None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:35.653462 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c9325-b2d5-4471-b370-b98453c22c9a None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:35.653462 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c9325-b2d5-4471-b370-b98453c22c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:35.715463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-284c9325-b2d5-4471-b370-b98453c22c9a None None] MFA Rules not processed for user `52a1e134c830490d9469e62dec14fffe`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:35.718788 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-284c9325-b2d5-4471-b370-b98453c22c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:35.848002 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 584/1177] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 11:59:35 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:59:35.853437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c436e6-cbdc-43af-b61f-75de1ffbe2df service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:35.865964 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c436e6-cbdc-43af-b61f-75de1ffbe2df service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:35.873500 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c7907-605e-4320-afe0-db38e43576b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:35.874535 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c7907-605e-4320-afe0-db38e43576b0 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:35.875209 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c7907-605e-4320-afe0-db38e43576b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:35.875716 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c7907-605e-4320-afe0-db38e43576b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:35.876692 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c7907-605e-4320-afe0-db38e43576b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:35.880714 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c7907-605e-4320-afe0-db38e43576b0 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:35.925795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 594/1178] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 14 11:59:35 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:59:35.929990 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c9325-b2d5-4471-b370-b98453c22c9a None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:35.950610 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c9325-b2d5-4471-b370-b98453c22c9a None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:36.011620 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:36.044756 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5e51c-04f0-4af1-8c7d-b99792244e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:36.045464 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5e51c-04f0-4af1-8c7d-b99792244e1d admin admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:36.045754 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5e51c-04f0-4af1-8c7d-b99792244e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:36.046041 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5e51c-04f0-4af1-8c7d-b99792244e1d admin admin] PATH_INFO: `/v3/users` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:36.046805 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5e51c-04f0-4af1-8c7d-b99792244e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:36.048903 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5e51c-04f0-4af1-8c7d-b99792244e1d admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:36.082514 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 585/1179] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 14 11:59:35 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:59:36.086146 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c7907-605e-4320-afe0-db38e43576b0 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:36.107589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c7907-605e-4320-afe0-db38e43576b0 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:36.118399 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78cc0d-b926-4f4a-80ed-cc57c26773c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:36.119121 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78cc0d-b926-4f4a-80ed-cc57c26773c0 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:36.122418 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78cc0d-b926-4f4a-80ed-cc57c26773c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:36.122815 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78cc0d-b926-4f4a-80ed-cc57c26773c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:36.125243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78cc0d-b926-4f4a-80ed-cc57c26773c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:36.129300 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78cc0d-b926-4f4a-80ed-cc57c26773c0 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:36.158112 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 595/1180] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 14 11:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:59:36.161925 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5e51c-04f0-4af1-8c7d-b99792244e1d admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:36.181060 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5e51c-04f0-4af1-8c7d-b99792244e1d admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:36.185868 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83289fc5-a6dc-4944-881f-e71b3ae8e1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:36.193464 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289fc5-a6dc-4944-881f-e71b3ae8e1e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:36.193915 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289fc5-a6dc-4944-881f-e71b3ae8e1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:36.194297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289fc5-a6dc-4944-881f-e71b3ae8e1e5 admin admin] PATH_INFO: `/v3/projects/15d5e29729564682ae4338be71d3c81f/users/77adb64c62704c428547534284019188/roles/321ee52ce1bc4eafa201f23f55f23d2b` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:36.214575 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83289fc5-a6dc-4944-881f-e71b3ae8e1e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d5e29729564682ae4338be71d3c81f, user_id=77adb64c62704c428547534284019188, role_id=321ee52ce1bc4eafa201f23f55f23d2b)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:36.218268 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83289fc5-a6dc-4944-881f-e71b3ae8e1e5 admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:36.238772 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 586/1181] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 14 11:59:36 2022] PUT /identity/v3/projects/15d5e29729564682ae4338be71d3c81f/users/77adb64c62704c428547534284019188/roles/321ee52ce1bc4eafa201f23f55f23d2b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:59:36.242632 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78cc0d-b926-4f4a-80ed-cc57c26773c0 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:36.255763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78cc0d-b926-4f4a-80ed-cc57c26773c0 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:36.327734 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:36.334739 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345714b2-624a-4c17-9b1c-0b79991855ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:36.336414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345714b2-624a-4c17-9b1c-0b79991855ca admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:36.336414 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345714b2-624a-4c17-9b1c-0b79991855ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:36.336931 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345714b2-624a-4c17-9b1c-0b79991855ca admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:36.338281 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345714b2-624a-4c17-9b1c-0b79991855ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:36.341131 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345714b2-624a-4c17-9b1c-0b79991855ca admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:36.354263 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 596/1182] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 14 11:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:59:36.358390 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83289fc5-a6dc-4944-881f-e71b3ae8e1e5 admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:36.375563 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83289fc5-a6dc-4944-881f-e71b3ae8e1e5 admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:36.382671 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efd2b0-13c8-4475-8f00-67b83e5288ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:36.383605 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efd2b0-13c8-4475-8f00-67b83e5288ea admin admin] REQUEST_METHOD: `PUT` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:36.384412 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efd2b0-13c8-4475-8f00-67b83e5288ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:36.384689 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efd2b0-13c8-4475-8f00-67b83e5288ea admin admin] PATH_INFO: `/v3/projects/15d5e29729564682ae4338be71d3c81f/users/77adb64c62704c428547534284019188/roles/321ee52ce1bc4eafa201f23f55f23d2b` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:36.386750 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efd2b0-13c8-4475-8f00-67b83e5288ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d5e29729564682ae4338be71d3c81f, user_id=77adb64c62704c428547534284019188, role_id=321ee52ce1bc4eafa201f23f55f23d2b)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:36.390508 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efd2b0-13c8-4475-8f00-67b83e5288ea admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:36.415783 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 587/1183] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 14 11:59:36 2022] PUT /identity/v3/projects/15d5e29729564682ae4338be71d3c81f/users/77adb64c62704c428547534284019188/roles/321ee52ce1bc4eafa201f23f55f23d2b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:59:36.419853 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6794a-7c17-4991-bd3a-3f8da93b2c4f None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:36.420254 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6794a-7c17-4991-bd3a-3f8da93b2c4f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:36.420490 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6794a-7c17-4991-bd3a-3f8da93b2c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:36.474215 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-95d6794a-7c17-4991-bd3a-3f8da93b2c4f None None] MFA Rules not processed for user `7fddb99331e44f22bb65fa2ca0d4850d`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:36.479094 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-95d6794a-7c17-4991-bd3a-3f8da93b2c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:36.591951 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 597/1184] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 11:59:36 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:59:36.593786 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efd2b0-13c8-4475-8f00-67b83e5288ea admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:36.687444 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efd2b0-13c8-4475-8f00-67b83e5288ea admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:36.694080 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e7fc3-3dd4-4e0c-ad90-b17d273acd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:36.694587 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e7fc3-3dd4-4e0c-ad90-b17d273acd50 admin admin] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:36.694876 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e7fc3-3dd4-4e0c-ad90-b17d273acd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:36.695204 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e7fc3-3dd4-4e0c-ad90-b17d273acd50 admin admin] PATH_INFO: `/v3/projects` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:36.696015 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e7fc3-3dd4-4e0c-ad90-b17d273acd50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:36.699226 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e7fc3-3dd4-4e0c-ad90-b17d273acd50 admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:36.735603 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 588/1185] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 14 11:59:36 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:59:36.739650 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6794a-7c17-4991-bd3a-3f8da93b2c4f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:36.754100 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6794a-7c17-4991-bd3a-3f8da93b2c4f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:36.838608 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7478d1f-de60-4f7b-bead-bea69b43b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:36.839191 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7478d1f-de60-4f7b-bead-bea69b43b303 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:36.839533 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7478d1f-de60-4f7b-bead-bea69b43b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:36.839883 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7478d1f-de60-4f7b-bead-bea69b43b303 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:36.841015 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7478d1f-de60-4f7b-bead-bea69b43b303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:36.843007 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7478d1f-de60-4f7b-bead-bea69b43b303 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:36.876581 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 598/1186] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 14 11:59:36 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:59:36.880370 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e7fc3-3dd4-4e0c-ad90-b17d273acd50 admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:36.893228 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e7fc3-3dd4-4e0c-ad90-b17d273acd50 admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:36.901334 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a8bd7-cc44-4396-9a1a-e09d7b677f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:36.902254 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a8bd7-cc44-4396-9a1a-e09d7b677f41 admin admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:36.902550 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a8bd7-cc44-4396-9a1a-e09d7b677f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:36.902979 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a8bd7-cc44-4396-9a1a-e09d7b677f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:36.903825 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a8bd7-cc44-4396-9a1a-e09d7b677f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:36.905764 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a8bd7-cc44-4396-9a1a-e09d7b677f41 admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:36.920035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 589/1187] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 14 11:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:59:36.922105 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7478d1f-de60-4f7b-bead-bea69b43b303 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:36.934614 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7478d1f-de60-4f7b-bead-bea69b43b303 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:36.941336 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d885c-1b9d-4d39-9320-a8ac2521e2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:36.943221 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d885c-1b9d-4d39-9320-a8ac2521e2a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:36.943576 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d885c-1b9d-4d39-9320-a8ac2521e2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:36.944095 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d885c-1b9d-4d39-9320-a8ac2521e2a7 admin admin] PATH_INFO: `/v3/projects/9db9662307b14f589c43112c648f0a8c/users/ddcc2df58ded481ba88d81b85a482331/roles/321ee52ce1bc4eafa201f23f55f23d2b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:36.972849 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d885c-1b9d-4d39-9320-a8ac2521e2a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db9662307b14f589c43112c648f0a8c, user_id=ddcc2df58ded481ba88d81b85a482331, role_id=321ee52ce1bc4eafa201f23f55f23d2b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:36.978554 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d885c-1b9d-4d39-9320-a8ac2521e2a7 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:37.000353 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 599/1188] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 14 11:59:36 2022] PUT /identity/v3/projects/9db9662307b14f589c43112c648f0a8c/users/ddcc2df58ded481ba88d81b85a482331/roles/321ee52ce1bc4eafa201f23f55f23d2b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:59:37.004039 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a8bd7-cc44-4396-9a1a-e09d7b677f41 admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:37.017800 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a8bd7-cc44-4396-9a1a-e09d7b677f41 admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:37.100836 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b309944-3716-4d9a-b14b-b3325b6fcc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:37.101711 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b309944-3716-4d9a-b14b-b3325b6fcc5b admin admin] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:37.101999 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b309944-3716-4d9a-b14b-b3325b6fcc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:37.102475 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b309944-3716-4d9a-b14b-b3325b6fcc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:37.103457 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b309944-3716-4d9a-b14b-b3325b6fcc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:37.105448 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b309944-3716-4d9a-b14b-b3325b6fcc5b admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:37.117699 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 590/1189] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 14 11:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:59:37.121383 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d885c-1b9d-4d39-9320-a8ac2521e2a7 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:37.132840 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d885c-1b9d-4d39-9320-a8ac2521e2a7 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:37.139701 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b964d6c-0c14-4334-9ed6-3a97be00d5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:37.140908 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b964d6c-0c14-4334-9ed6-3a97be00d5ee admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:37.141401 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b964d6c-0c14-4334-9ed6-3a97be00d5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:37.141918 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b964d6c-0c14-4334-9ed6-3a97be00d5ee admin admin] PATH_INFO: `/v3/projects/9db9662307b14f589c43112c648f0a8c/users/ddcc2df58ded481ba88d81b85a482331/roles/321ee52ce1bc4eafa201f23f55f23d2b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:37.145497 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b964d6c-0c14-4334-9ed6-3a97be00d5ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db9662307b14f589c43112c648f0a8c, user_id=ddcc2df58ded481ba88d81b85a482331, role_id=321ee52ce1bc4eafa201f23f55f23d2b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:37.152126 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b964d6c-0c14-4334-9ed6-3a97be00d5ee admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:37.169475 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 600/1190] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 14 11:59:37 2022] PUT /identity/v3/projects/9db9662307b14f589c43112c648f0a8c/users/ddcc2df58ded481ba88d81b85a482331/roles/321ee52ce1bc4eafa201f23f55f23d2b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:59:42.798253 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6030597-9568-4881-998d-63d5fa8d7907 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:42.798811 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6030597-9568-4881-998d-63d5fa8d7907 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:42.798811 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6030597-9568-4881-998d-63d5fa8d7907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:42.820286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:42.842877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-a6030597-9568-4881-998d-63d5fa8d7907 None None] MFA Rules not processed for user `77adb64c62704c428547534284019188`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:42.848298 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-a6030597-9568-4881-998d-63d5fa8d7907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:42.953390 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 591/1191] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 11:59:42 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:59:42.966449 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b964d6c-0c14-4334-9ed6-3a97be00d5ee admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:42.969293 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1b964d6c-0c14-4334-9ed6-3a97be00d5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:43.019253 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:43.068798 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b964d6c-0c14-4334-9ed6-3a97be00d5ee admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:43.081949 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56084647-be7c-4466-b5b4-69ddfe62d6eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ac098792b924ce887b3e3abfe596c8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:43.082624 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56084647-be7c-4466-b5b4-69ddfe62d6eb service glance] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:43.082912 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56084647-be7c-4466-b5b4-69ddfe62d6eb service glance] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:43.083192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56084647-be7c-4466-b5b4-69ddfe62d6eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:43.200440 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56084647-be7c-4466-b5b4-69ddfe62d6eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:43.206782 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56084647-be7c-4466-b5b4-69ddfe62d6eb service glance] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:43.221306 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 601/1192] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:59:42 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:59:43.742377 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c523a-a4f4-41d8-b816-4b7f09c071ed None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:43.742729 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c523a-a4f4-41d8-b816-4b7f09c071ed None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:43.743632 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c523a-a4f4-41d8-b816-4b7f09c071ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:43.845666 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-fa2c523a-a4f4-41d8-b816-4b7f09c071ed None None] MFA Rules not processed for user `ddcc2df58ded481ba88d81b85a482331`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:43.847098 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-fa2c523a-a4f4-41d8-b816-4b7f09c071ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:43.949026 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 592/1193] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 11:59:43 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:59:43.964162 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56084647-be7c-4466-b5b4-69ddfe62d6eb service glance] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:43.973441 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56084647-be7c-4466-b5b4-69ddfe62d6eb service glance] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:43.979135 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2029-7b73-42df-ab06-9d9ed6173bb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ac098792b924ce887b3e3abfe596c8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:43.981638 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2029-7b73-42df-ab06-9d9ed6173bb8 service glance] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:43.982196 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2029-7b73-42df-ab06-9d9ed6173bb8 service glance] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:43.982314 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2029-7b73-42df-ab06-9d9ed6173bb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:44.075556 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d2029-7b73-42df-ab06-9d9ed6173bb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:44.077171 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d2029-7b73-42df-ab06-9d9ed6173bb8 service glance] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:44.102947 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 602/1194] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:59:43 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:59:52.261809 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a5c5-fe27-4808-94d8-fe5aebe71416 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:52.262377 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a5c5-fe27-4808-94d8-fe5aebe71416 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:52.262377 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a5c5-fe27-4808-94d8-fe5aebe71416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:52.282501 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-7151a5c5-fe27-4808-94d8-fe5aebe71416 None None] MFA Rules not processed for user `52a1e134c830490d9469e62dec14fffe`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:52.283764 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-7151a5c5-fe27-4808-94d8-fe5aebe71416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:52.291227 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 593/1195] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 11:59:52 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:59:52.602674 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06187a50-dcb1-4810-8dab-6c2439400106 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:52.603437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06187a50-dcb1-4810-8dab-6c2439400106 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:52.603437 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06187a50-dcb1-4810-8dab-6c2439400106 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:52.605232 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 603/1196] 10.222.0.49 () {54 vars in 961 bytes} [Thu Jul 14 11:59:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:59:52.611105 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade2ffb-70d7-4e36-a3b9-46e8d6142a5b None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:52.611399 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade2ffb-70d7-4e36-a3b9-46e8d6142a5b None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:52.611677 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade2ffb-70d7-4e36-a3b9-46e8d6142a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:52.650495 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-0ade2ffb-70d7-4e36-a3b9-46e8d6142a5b None None] MFA Rules not processed for user `6fd8e197398e465aa3247d2ea89430d8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:52.652353 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-0ade2ffb-70d7-4e36-a3b9-46e8d6142a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:52.724085 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=100 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:52.742157 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 594/1197] 10.222.0.49 () {58 vars in 1058 bytes} [Thu Jul 14 11:59:52 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:59:52.747982 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365a6c8-8f18-473a-8905-724a107389af None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:52.748642 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365a6c8-8f18-473a-8905-724a107389af None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:52.748932 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365a6c8-8f18-473a-8905-724a107389af None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:52.750333 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 604/1198] 10.222.0.49 () {54 vars in 912 bytes} [Thu Jul 14 11:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:59:52.756480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c13fa-b29c-443a-bfe6-34da79dba9c4 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:52.756778 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c13fa-b29c-443a-bfe6-34da79dba9c4 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:52.757104 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c13fa-b29c-443a-bfe6-34da79dba9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:52.784580 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-ba7c13fa-b29c-443a-bfe6-34da79dba9c4 None None] MFA Rules not processed for user `6fd8e197398e465aa3247d2ea89430d8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:52.786035 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-ba7c13fa-b29c-443a-bfe6-34da79dba9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:52.797563 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 595/1199] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 14 11:59:52 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:59:52.811398 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365a6c8-8f18-473a-8905-724a107389af None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:52.813488 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4365a6c8-8f18-473a-8905-724a107389af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:52.829311 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365a6c8-8f18-473a-8905-724a107389af None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:52.833047 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bc470-1ddb-41fa-8807-d67db16e8307 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ac098792b924ce887b3e3abfe596c8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:52.833713 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bc470-1ddb-41fa-8807-d67db16e8307 service glance] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:52.834001 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bc470-1ddb-41fa-8807-d67db16e8307 service glance] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:52.834287 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bc470-1ddb-41fa-8807-d67db16e8307 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:52.846688 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bc470-1ddb-41fa-8807-d67db16e8307 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:52.848472 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bc470-1ddb-41fa-8807-d67db16e8307 service glance] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:52.859344 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 605/1200] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:59:52 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:59:53.239491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8166e9-964d-45fd-a521-1d612debd235 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:53.239813 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8166e9-964d-45fd-a521-1d612debd235 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:53.240131 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8166e9-964d-45fd-a521-1d612debd235 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:53.241511 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 596/1201] 10.222.0.49 () {54 vars in 912 bytes} [Thu Jul 14 11:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:59:53.247039 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0e361-772f-4651-936d-6bf01d996464 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:53.247343 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0e361-772f-4651-936d-6bf01d996464 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:53.247696 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0e361-772f-4651-936d-6bf01d996464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:53.285573 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-53f0e361-772f-4651-936d-6bf01d996464 None None] MFA Rules not processed for user `336c852c9dfb4c6a8ee62134c2ff32ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:53.287248 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-53f0e361-772f-4651-936d-6bf01d996464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:53.341693 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:53.350351 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 606/1202] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 14 11:59:53 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:59:53.370376 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8166e9-964d-45fd-a521-1d612debd235 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:53.383103 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8166e9-964d-45fd-a521-1d612debd235 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:53.390735 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23a7b3-0957-414d-bd70-ef389fb9d48a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:53.392073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23a7b3-0957-414d-bd70-ef389fb9d48a service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:53.392744 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23a7b3-0957-414d-bd70-ef389fb9d48a service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:53.393204 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23a7b3-0957-414d-bd70-ef389fb9d48a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:53.402625 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23a7b3-0957-414d-bd70-ef389fb9d48a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:53.404124 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23a7b3-0957-414d-bd70-ef389fb9d48a service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:53.412590 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 597/1203] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:59:53 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:59:53.994867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28064f-90b2-4f30-99f5-4f0e9b4470c9 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:53.995365 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28064f-90b2-4f30-99f5-4f0e9b4470c9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:53.995632 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28064f-90b2-4f30-99f5-4f0e9b4470c9 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:53.997775 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 607/1204] 10.222.0.49 () {54 vars in 961 bytes} [Thu Jul 14 11:59:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:59:54.004657 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e09a8-f465-48d4-9a19-a6ad8ed73b33 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:54.004962 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e09a8-f465-48d4-9a19-a6ad8ed73b33 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:54.005229 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e09a8-f465-48d4-9a19-a6ad8ed73b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:54.048691 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc68e21-69ef-4047-9cb4-7a8c5783f5fd None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:54.049236 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc68e21-69ef-4047-9cb4-7a8c5783f5fd None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:54.049866 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc68e21-69ef-4047-9cb4-7a8c5783f5fd None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:54.051458 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-966e09a8-f465-48d4-9a19-a6ad8ed73b33 None None] MFA Rules not processed for user `6fd8e197398e465aa3247d2ea89430d8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:54.052261 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 608/1205] 10.222.0.49 () {54 vars in 960 bytes} [Thu Jul 14 11:59:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:59:54.053889 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-966e09a8-f465-48d4-9a19-a6ad8ed73b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:54.060429 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071c44e-36c7-48e5-a81e-99414740b18a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:54.060429 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071c44e-36c7-48e5-a81e-99414740b18a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:54.060429 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071c44e-36c7-48e5-a81e-99414740b18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:54.076965 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 598/1206] 10.222.0.49 () {58 vars in 1058 bytes} [Thu Jul 14 11:59:54 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:59:54.093573 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29eea5-d537-49d3-ad26-a270e8825e28 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:54.093930 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29eea5-d537-49d3-ad26-a270e8825e28 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:54.094893 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29eea5-d537-49d3-ad26-a270e8825e28 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:54.096359 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 599/1207] 10.222.0.49 () {54 vars in 912 bytes} [Thu Jul 14 11:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:59:54.096498 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e071c44e-36c7-48e5-a81e-99414740b18a None None] MFA Rules not processed for user `de477915cf5e41e8a65a57e8b546997f`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:54.097408 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e071c44e-36c7-48e5-a81e-99414740b18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:54.105237 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77edce-4057-49f6-9a40-655d0ea822d7 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:54.105529 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77edce-4057-49f6-9a40-655d0ea822d7 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:54.105818 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77edce-4057-49f6-9a40-655d0ea822d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:54.136826 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-2c77edce-4057-49f6-9a40-655d0ea822d7 None None] MFA Rules not processed for user `6fd8e197398e465aa3247d2ea89430d8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:54.138063 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-2c77edce-4057-49f6-9a40-655d0ea822d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:54.149480 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 600/1208] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 14 11:59:54 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:59:54.163841 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77edce-4057-49f6-9a40-655d0ea822d7 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:54.201958 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77edce-4057-49f6-9a40-655d0ea822d7 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:54.206463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dbc06-d434-4738-b722-5f46a1fd5ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:54.207330 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dbc06-d434-4738-b722-5f46a1fd5ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:54.207618 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dbc06-d434-4738-b722-5f46a1fd5ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:54.208003 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dbc06-d434-4738-b722-5f46a1fd5ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:54.219607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dbc06-d434-4738-b722-5f46a1fd5ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:54.221120 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dbc06-d434-4738-b722-5f46a1fd5ee6 service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:54.228888 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 609/1209] 10.222.0.49 () {58 vars in 1057 bytes} [Thu Jul 14 11:59:54 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:59:54.233142 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071c44e-36c7-48e5-a81e-99414740b18a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:54.234334 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 601/1210] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:59:54 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:59:54.250764 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071c44e-36c7-48e5-a81e-99414740b18a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:54.257911 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9434a8-e8b0-4959-bb41-d6347c918757 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de477915cf5e41e8a65a57e8b546997f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:54.258965 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9434a8-e8b0-4959-bb41-d6347c918757 service placement] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:54.259530 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9434a8-e8b0-4959-bb41-d6347c918757 service placement] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:54.259951 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9434a8-e8b0-4959-bb41-d6347c918757 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:54.262180 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4e9434a8-e8b0-4959-bb41-d6347c918757 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:54.281024 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9434a8-e8b0-4959-bb41-d6347c918757 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:54.282771 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9434a8-e8b0-4959-bb41-d6347c918757 service placement] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:54.313683 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 610/1211] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 11:59:54 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:00:04.148607 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f782f-e016-4949-977c-16d5b1455c1c None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:04.149250 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f782f-e016-4949-977c-16d5b1455c1c None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:04.149426 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f782f-e016-4949-977c-16d5b1455c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:04.169204 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-641f782f-e016-4949-977c-16d5b1455c1c None None] MFA Rules not processed for user `336c852c9dfb4c6a8ee62134c2ff32ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:04.170540 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-641f782f-e016-4949-977c-16d5b1455c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:04.177170 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 602/1212] 10.222.0.30 () {58 vars in 1015 bytes} [Thu Jul 14 12:00:04 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:04.189667 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9434a8-e8b0-4959-bb41-d6347c918757 service placement] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:04.198911 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9434a8-e8b0-4959-bb41-d6347c918757 service placement] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:04.202624 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f01d3-d205-40d3-ae62-9c098702aeb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:04.203243 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f01d3-d205-40d3-ae62-9c098702aeb4 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:04.203534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f01d3-d205-40d3-ae62-9c098702aeb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:04.203816 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f01d3-d205-40d3-ae62-9c098702aeb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:04.212478 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f01d3-d205-40d3-ae62-9c098702aeb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:04.213925 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f01d3-d205-40d3-ae62-9c098702aeb4 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:04.222079 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 611/1213] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:04 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:00:05.122401 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca514df-2ef3-44e0-9e77-2c028d7cb399 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:05.123401 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca514df-2ef3-44e0-9e77-2c028d7cb399 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:05.124061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca514df-2ef3-44e0-9e77-2c028d7cb399 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:05.126924 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 603/1214] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 14 12:00:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:05.165975 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa6248-9176-4068-bf26-58b99e05510d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:05.166837 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa6248-9176-4068-bf26-58b99e05510d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:05.167292 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa6248-9176-4068-bf26-58b99e05510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:05.218410 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e2aa6248-9176-4068-bf26-58b99e05510d None None] MFA Rules not processed for user `6fd8e197398e465aa3247d2ea89430d8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:05.222418 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e2aa6248-9176-4068-bf26-58b99e05510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:05.256624 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 612/1215] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 14 12:00:05 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:05.272821 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca514df-2ef3-44e0-9e77-2c028d7cb399 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:05.291085 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca514df-2ef3-44e0-9e77-2c028d7cb399 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:05.299806 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026fdb6-83d8-48f2-afa2-a6b9678a0466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:05.300494 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026fdb6-83d8-48f2-afa2-a6b9678a0466 service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:05.300967 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026fdb6-83d8-48f2-afa2-a6b9678a0466 service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:05.301941 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026fdb6-83d8-48f2-afa2-a6b9678a0466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:05.313204 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026fdb6-83d8-48f2-afa2-a6b9678a0466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:05.315271 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026fdb6-83d8-48f2-afa2-a6b9678a0466 service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:05.328686 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 604/1216] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:05 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:10.999568 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6bb0d-3288-47bc-a90b-1517e4b30d62 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:11.000157 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6bb0d-3288-47bc-a90b-1517e4b30d62 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:11.000157 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6bb0d-3288-47bc-a90b-1517e4b30d62 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:11.001786 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 613/1217] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 14 12:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:11.015169 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eec94-7264-4908-8b78-c365ac09bfba None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:11.015650 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eec94-7264-4908-8b78-c365ac09bfba None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:11.015650 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eec94-7264-4908-8b78-c365ac09bfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:11.044828 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-807eec94-7264-4908-8b78-c365ac09bfba None None] MFA Rules not processed for user `6fd8e197398e465aa3247d2ea89430d8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:11.044828 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-807eec94-7264-4908-8b78-c365ac09bfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:11.046743 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 605/1218] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 14 12:00:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:11.068477 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6bb0d-3288-47bc-a90b-1517e4b30d62 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:11.084752 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6bb0d-3288-47bc-a90b-1517e4b30d62 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:11.101532 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a509f-7bdc-4fb6-b525-550b2cb18ffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:11.102536 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a509f-7bdc-4fb6-b525-550b2cb18ffb service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:11.103010 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a509f-7bdc-4fb6-b525-550b2cb18ffb service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:11.103295 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a509f-7bdc-4fb6-b525-550b2cb18ffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:11.113835 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a509f-7bdc-4fb6-b525-550b2cb18ffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:11.115434 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a509f-7bdc-4fb6-b525-550b2cb18ffb service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:11.125762 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 614/1219] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:21.030364 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=35 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:21.121451 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=50 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:23.136462 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807eec94-7264-4908-8b78-c365ac09bfba None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:23.145910 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807eec94-7264-4908-8b78-c365ac09bfba None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:23.149633 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e532b-f185-4f3d-800b-fdc991e3c69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:23.150277 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e532b-f185-4f3d-800b-fdc991e3c69e service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:23.150564 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e532b-f185-4f3d-800b-fdc991e3c69e service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:23.150873 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e532b-f185-4f3d-800b-fdc991e3c69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:23.160071 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e532b-f185-4f3d-800b-fdc991e3c69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:23.161545 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e532b-f185-4f3d-800b-fdc991e3c69e service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:23.171942 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 606/1220] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:23 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:25.221314 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b8f4b-f3e6-4ffd-84c6-6a947638d219 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:25.221905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b8f4b-f3e6-4ffd-84c6-6a947638d219 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:25.221905 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b8f4b-f3e6-4ffd-84c6-6a947638d219 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:25.223271 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 615/1221] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 14 12:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:25.230469 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4690291-d343-4af0-8e15-e18936b8f26f None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:25.231027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4690291-d343-4af0-8e15-e18936b8f26f None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:25.231027 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4690291-d343-4af0-8e15-e18936b8f26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:25.257491 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-a4690291-d343-4af0-8e15-e18936b8f26f None None] MFA Rules not processed for user `6fd8e197398e465aa3247d2ea89430d8`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:25.259118 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-a4690291-d343-4af0-8e15-e18936b8f26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:25.277808 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 607/1222] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 14 12:00:25 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:25.294950 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b8f4b-f3e6-4ffd-84c6-6a947638d219 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:25.312429 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b8f4b-f3e6-4ffd-84c6-6a947638d219 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:25.318412 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd1163-83bb-4ce2-93a1-b445ec082c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:25.319067 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd1163-83bb-4ce2-93a1-b445ec082c66 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:25.319356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd1163-83bb-4ce2-93a1-b445ec082c66 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:25.319685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd1163-83bb-4ce2-93a1-b445ec082c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:25.329486 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd1163-83bb-4ce2-93a1-b445ec082c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:25.331090 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd1163-83bb-4ce2-93a1-b445ec082c66 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:25.342324 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 616/1223] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:25 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:35.247815 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=9 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:35.338149 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=6 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:43.015662 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee40770-a321-45bf-8d9a-e1818b132568 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:43.016255 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee40770-a321-45bf-8d9a-e1818b132568 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:43.016255 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee40770-a321-45bf-8d9a-e1818b132568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:43.033950 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-dee40770-a321-45bf-8d9a-e1818b132568 None None] MFA Rules not processed for user `7fddb99331e44f22bb65fa2ca0d4850d`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:43.035085 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-dee40770-a321-45bf-8d9a-e1818b132568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:43.042958 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 608/1224] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 12:00:43 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:43.370380 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1b938-11cb-4e3c-ac64-a8896fcc9794 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:43.370892 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1b938-11cb-4e3c-ac64-a8896fcc9794 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:43.371001 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1b938-11cb-4e3c-ac64-a8896fcc9794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:43.389127 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-cbb1b938-11cb-4e3c-ac64-a8896fcc9794 None None] MFA Rules not processed for user `336c852c9dfb4c6a8ee62134c2ff32ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:43.390337 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-cbb1b938-11cb-4e3c-ac64-a8896fcc9794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:43.396710 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 617/1225] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 14 12:00:43 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:43.409043 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee40770-a321-45bf-8d9a-e1818b132568 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:43.419067 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee40770-a321-45bf-8d9a-e1818b132568 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:43.423122 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e173421-1dc1-434c-ab50-962093b38092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:43.424300 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e173421-1dc1-434c-ab50-962093b38092 service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:43.424807 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e173421-1dc1-434c-ab50-962093b38092 service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:43.425296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e173421-1dc1-434c-ab50-962093b38092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:43.434792 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e173421-1dc1-434c-ab50-962093b38092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:43.436318 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e173421-1dc1-434c-ab50-962093b38092 service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:43.444377 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 609/1226] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:43 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:53.384525 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:53.440961 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=9 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:07.014319 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f7f36-cd4d-42af-a077-9dc3275640f8 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:07.014800 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f7f36-cd4d-42af-a077-9dc3275640f8 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:07.014888 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f7f36-cd4d-42af-a077-9dc3275640f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:07.031876 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-208f7f36-cd4d-42af-a077-9dc3275640f8 None None] MFA Rules not processed for user `7fddb99331e44f22bb65fa2ca0d4850d`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:07.033080 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-208f7f36-cd4d-42af-a077-9dc3275640f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:07.039986 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 618/1227] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 12:01:07 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:17.027001 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:21.457623 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85105b57-6fcd-4271-80a7-b9e3102952e1 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:21.458103 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85105b57-6fcd-4271-80a7-b9e3102952e1 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:21.458201 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85105b57-6fcd-4271-80a7-b9e3102952e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:21.475569 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-85105b57-6fcd-4271-80a7-b9e3102952e1 None None] MFA Rules not processed for user `7fddb99331e44f22bb65fa2ca0d4850d`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:21.477282 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-85105b57-6fcd-4271-80a7-b9e3102952e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:21.484276 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 610/1228] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 12:01:21 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:31.470578 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=3 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:18.763113 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323c52-a16f-4bd7-9ff5-b7974c97bdc6 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:18.763596 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323c52-a16f-4bd7-9ff5-b7974c97bdc6 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:18.763763 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323c52-a16f-4bd7-9ff5-b7974c97bdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:18.781265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-d4323c52-a16f-4bd7-9ff5-b7974c97bdc6 None None] MFA Rules not processed for user `7fddb99331e44f22bb65fa2ca0d4850d`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:18.783065 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d4323c52-a16f-4bd7-9ff5-b7974c97bdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:18.789890 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 619/1229] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 12:02:18 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:28.776320 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:29.365877 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85105b57-6fcd-4271-80a7-b9e3102952e1 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:29.384867 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85105b57-6fcd-4271-80a7-b9e3102952e1 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:29.388393 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9ebd3-5112-463a-a9f3-f087ba453ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:29.389034 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9ebd3-5112-463a-a9f3-f087ba453ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:29.389317 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9ebd3-5112-463a-a9f3-f087ba453ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:29.389595 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9ebd3-5112-463a-a9f3-f087ba453ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:29.398798 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9ebd3-5112-463a-a9f3-f087ba453ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:29.400327 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9ebd3-5112-463a-a9f3-f087ba453ac1 service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:29.410228 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 611/1230] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:29 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:02:39.405504 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=10 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:03:57.943133 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4323c52-a16f-4bd7-9ff5-b7974c97bdc6 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:03:57.964845 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4323c52-a16f-4bd7-9ff5-b7974c97bdc6 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:03:57.970987 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c97bf-5910-46e4-ac2f-d39cdee51eed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de477915cf5e41e8a65a57e8b546997f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:03:57.971632 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c97bf-5910-46e4-ac2f-d39cdee51eed service placement] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:03:57.972005 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c97bf-5910-46e4-ac2f-d39cdee51eed service placement] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:03:57.972311 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c97bf-5910-46e4-ac2f-d39cdee51eed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:03:57.980934 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c97bf-5910-46e4-ac2f-d39cdee51eed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:03:57.983029 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c97bf-5910-46e4-ac2f-d39cdee51eed service placement] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:03:57.992948 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 620/1231] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:03:57 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:04:07.988848 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=10 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:04:15.077093 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc3108-5e74-4b40-83c4-50f85191739e None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:15.078128 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc3108-5e74-4b40-83c4-50f85191739e None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:15.078827 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc3108-5e74-4b40-83c4-50f85191739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:15.097178 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-e4cc3108-5e74-4b40-83c4-50f85191739e None None] MFA Rules not processed for user `52a1e134c830490d9469e62dec14fffe`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:04:15.098388 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-e4cc3108-5e74-4b40-83c4-50f85191739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:15.105512 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 612/1232] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 12:04:15 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:04:25.090979 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=3 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:04:41.058205 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6af6e4-ab08-4405-9b58-42d1cab3ce79 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:41.058712 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6af6e4-ab08-4405-9b58-42d1cab3ce79 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:41.058795 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6af6e4-ab08-4405-9b58-42d1cab3ce79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:41.078178 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-7c6af6e4-ab08-4405-9b58-42d1cab3ce79 None None] MFA Rules not processed for user `7fddb99331e44f22bb65fa2ca0d4850d`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:04:41.080019 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7c6af6e4-ab08-4405-9b58-42d1cab3ce79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:41.087316 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 621/1233] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 12:04:41 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:04:42.160224 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc3108-5e74-4b40-83c4-50f85191739e None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:04:42.173474 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc3108-5e74-4b40-83c4-50f85191739e None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:04:42.177231 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a08a4e-d1c0-4c59-b19a-7d1d005f40c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:04:42.178016 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a08a4e-d1c0-4c59-b19a-7d1d005f40c0 service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:42.178401 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a08a4e-d1c0-4c59-b19a-7d1d005f40c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:42.179060 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a08a4e-d1c0-4c59-b19a-7d1d005f40c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:42.189682 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a08a4e-d1c0-4c59-b19a-7d1d005f40c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:04:42.191464 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a08a4e-d1c0-4c59-b19a-7d1d005f40c0 service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:04:42.211356 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 613/1234] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:04:42 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:04:43.170700 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6af6e4-ab08-4405-9b58-42d1cab3ce79 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:04:43.202528 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6af6e4-ab08-4405-9b58-42d1cab3ce79 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:04:43.206867 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506afd4-1f1d-4105-b5d2-a404a43a98a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:04:43.207790 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506afd4-1f1d-4105-b5d2-a404a43a98a0 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:43.208586 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506afd4-1f1d-4105-b5d2-a404a43a98a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:43.208586 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506afd4-1f1d-4105-b5d2-a404a43a98a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:43.219782 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a08a4e-d1c0-4c59-b19a-7d1d005f40c0 service neutron] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:04:43.221785 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506afd4-1f1d-4105-b5d2-a404a43a98a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:04:43.224016 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506afd4-1f1d-4105-b5d2-a404a43a98a0 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:04:43.236170 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 622/1235] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:04:43 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:04:43.253176 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a08a4e-d1c0-4c59-b19a-7d1d005f40c0 service neutron] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:04:43.261183 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863dd61-f360-4af6-816f-affdac6b44a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:04:43.262074 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863dd61-f360-4af6-816f-affdac6b44a9 service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:43.262500 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863dd61-f360-4af6-816f-affdac6b44a9 service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:43.262920 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863dd61-f360-4af6-816f-affdac6b44a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:43.275700 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863dd61-f360-4af6-816f-affdac6b44a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:04:43.277632 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863dd61-f360-4af6-816f-affdac6b44a9 service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:04:43.289661 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 614/1236] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:04:43 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:04:51.964458 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506afd4-1f1d-4105-b5d2-a404a43a98a0 service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:04:51.972963 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506afd4-1f1d-4105-b5d2-a404a43a98a0 service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:04:51.977724 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c22224-eb71-4cf6-9123-67f5b8585f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:04:51.978359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c22224-eb71-4cf6-9123-67f5b8585f31 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:51.978648 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c22224-eb71-4cf6-9123-67f5b8585f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:51.978931 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c22224-eb71-4cf6-9123-67f5b8585f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:51.988175 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c22224-eb71-4cf6-9123-67f5b8585f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:04:51.989608 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c22224-eb71-4cf6-9123-67f5b8585f31 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:04:52.000262 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 623/1237] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:04:51 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:04:53.283913 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=16 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:05:01.996099 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=15 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:05:08.955397 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863dd61-f360-4af6-816f-affdac6b44a9 service nova] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:05:08.965005 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863dd61-f360-4af6-816f-affdac6b44a9 service nova] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:05:08.968463 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195ce9f-1318-4630-a7f7-f278c993eece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:05:08.969090 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195ce9f-1318-4630-a7f7-f278c993eece service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:05:08.969373 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195ce9f-1318-4630-a7f7-f278c993eece service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:05:08.969646 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195ce9f-1318-4630-a7f7-f278c993eece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:05:08.980168 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195ce9f-1318-4630-a7f7-f278c993eece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:05:08.981593 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195ce9f-1318-4630-a7f7-f278c993eece service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:05:08.991758 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 615/1238] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:05:08 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:05:09.009193 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c22224-eb71-4cf6-9123-67f5b8585f31 service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:05:09.017537 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c22224-eb71-4cf6-9123-67f5b8585f31 service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:05:09.021246 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca866df-88b7-4f85-ba03-159b3861f811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:05:09.021915 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca866df-88b7-4f85-ba03-159b3861f811 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:05:09.022203 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca866df-88b7-4f85-ba03-159b3861f811 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:05:09.022483 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca866df-88b7-4f85-ba03-159b3861f811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:05:09.030347 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca866df-88b7-4f85-ba03-159b3861f811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:05:09.031779 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca866df-88b7-4f85-ba03-159b3861f811 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:05:09.039686 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 624/1239] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:05:09 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:05:18.987363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=6 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:05:19.036331 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=6 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:06:00.636322 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195ce9f-1318-4630-a7f7-f278c993eece service neutron] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:00.653909 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195ce9f-1318-4630-a7f7-f278c993eece service neutron] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:00.669704 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494de6f2-252f-4d9c-8ba1-e1271608156d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:00.670633 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de6f2-252f-4d9c-8ba1-e1271608156d service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:00.671111 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de6f2-252f-4d9c-8ba1-e1271608156d service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:00.671397 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de6f2-252f-4d9c-8ba1-e1271608156d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:00.680756 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494de6f2-252f-4d9c-8ba1-e1271608156d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:00.683599 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494de6f2-252f-4d9c-8ba1-e1271608156d service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:00.694160 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 616/1240] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:06:00 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:06:08.732517 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca866df-88b7-4f85-ba03-159b3861f811 service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:08.740861 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca866df-88b7-4f85-ba03-159b3861f811 service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:08.745031 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a814aca-c53d-4e65-90a1-f38898480ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:08.745647 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a814aca-c53d-4e65-90a1-f38898480ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:08.745974 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a814aca-c53d-4e65-90a1-f38898480ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:08.746155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a814aca-c53d-4e65-90a1-f38898480ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:08.808288 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a814aca-c53d-4e65-90a1-f38898480ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:08.809731 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a814aca-c53d-4e65-90a1-f38898480ea7 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:08.827669 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 625/1241] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:06:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:06:10.689894 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=6 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:06:12.073031 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d9d6d-17d5-4529-bcd2-b66c7f3bae43 None None] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:12.073606 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d9d6d-17d5-4529-bcd2-b66c7f3bae43 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:12.073606 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d9d6d-17d5-4529-bcd2-b66c7f3bae43 None None] PATH_INFO: `/` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:12.076532 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 617/1242] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 14 12:06:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:06:12.106350 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321bcbe-3f5c-4e4d-8992-3bfe49ae72a6 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:12.106880 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321bcbe-3f5c-4e4d-8992-3bfe49ae72a6 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:12.106971 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321bcbe-3f5c-4e4d-8992-3bfe49ae72a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:12.180194 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-9321bcbe-3f5c-4e4d-8992-3bfe49ae72a6 None None] MFA Rules not processed for user `de477915cf5e41e8a65a57e8b546997f`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:06:12.182777 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9321bcbe-3f5c-4e4d-8992-3bfe49ae72a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:12.195356 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 626/1243] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 14 12:06:12 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:06:12.235579 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d9d6d-17d5-4529-bcd2-b66c7f3bae43 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:12.249696 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d9d6d-17d5-4529-bcd2-b66c7f3bae43 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:12.254605 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b53256-ec30-478f-97c4-949fc8b47c1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de477915cf5e41e8a65a57e8b546997f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:12.255277 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b53256-ec30-478f-97c4-949fc8b47c1f service placement] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:12.255563 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b53256-ec30-478f-97c4-949fc8b47c1f service placement] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:12.255843 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b53256-ec30-478f-97c4-949fc8b47c1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:12.264707 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b53256-ec30-478f-97c4-949fc8b47c1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:12.266382 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b53256-ec30-478f-97c4-949fc8b47c1f service placement] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:12.276809 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 618/1244] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:06:12 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:06:15.344571 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321bcbe-3f5c-4e4d-8992-3bfe49ae72a6 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:15.356685 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321bcbe-3f5c-4e4d-8992-3bfe49ae72a6 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:15.362223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d152d-85e6-492e-beee-74cab1c0eb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:15.363366 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d152d-85e6-492e-beee-74cab1c0eb11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:15.363743 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d152d-85e6-492e-beee-74cab1c0eb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:15.364128 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d152d-85e6-492e-beee-74cab1c0eb11 admin admin] PATH_INFO: `/v3/users/52a1e134c830490d9469e62dec14fffe` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:15.365332 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d152d-85e6-492e-beee-74cab1c0eb11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a1e134c830490d9469e62dec14fffe)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:15.366363 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: WARNING py.warnings [None req-7e7d152d-85e6-492e-beee-74cab1c0eb11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:06:15.366363 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: warnings.warn(msg) Jul 14 12:06:15.366363 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: Jul 14 12:06:15.367588 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d152d-85e6-492e-beee-74cab1c0eb11 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:15.432413 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7e7d152d-85e6-492e-beee-74cab1c0eb11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a1e134c830490d9469e62dec14fffe'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:15.463230 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7e7d152d-85e6-492e-beee-74cab1c0eb11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a1e134c830490d9469e62dec14fffe'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:15.463517 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7e7d152d-85e6-492e-beee-74cab1c0eb11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a1e134c830490d9469e62dec14fffe'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:15.464163 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7e7d152d-85e6-492e-beee-74cab1c0eb11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a1e134c830490d9469e62dec14fffe'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:15.479301 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7e7d152d-85e6-492e-beee-74cab1c0eb11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a1e134c830490d9469e62dec14fffe'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:15.495814 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 627/1245] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 14 12:06:15 2022] DELETE /identity/v3/users/52a1e134c830490d9469e62dec14fffe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:06:15.680286 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b53256-ec30-478f-97c4-949fc8b47c1f service placement] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:15.695189 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b53256-ec30-478f-97c4-949fc8b47c1f service placement] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:15.755182 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:15.755999 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:15.756289 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:15.756595 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] PATH_INFO: `/v3/projects/c0a6362bd479483b9cffee149bb623d7` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:15.757771 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a6362bd479483b9cffee149bb623d7)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:15.759481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: WARNING py.warnings [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:06:15.759481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: warnings.warn(msg) Jul 14 12:06:15.759481 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: Jul 14 12:06:15.760650 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:15.817118 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a6362bd479483b9cffee149bb623d7', 'request_id': 'req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:15.831155 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a6362bd479483b9cffee149bb623d7', 'request_id': 'req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:15.837433 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a6362bd479483b9cffee149bb623d7', 'request_id': 'req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:15.851079 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] The token cache is being invalidate because project c0a6362bd479483b9cffee149bb623d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:06:15.851382 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:15.852073 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:15.853686 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 619/1246] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 14 12:06:15 2022] DELETE /identity/v3/projects/c0a6362bd479483b9cffee149bb623d7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:06:15.857719 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d152d-85e6-492e-beee-74cab1c0eb11 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:15.859161 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7e7d152d-85e6-492e-beee-74cab1c0eb11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:15.872553 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d152d-85e6-492e-beee-74cab1c0eb11 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:15.885020 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:06:15.930563 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650006e2-a2cc-47d3-a7dc-ac6e97ccd64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:15.932062 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650006e2-a2cc-47d3-a7dc-ac6e97ccd64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:15.932367 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650006e2-a2cc-47d3-a7dc-ac6e97ccd64c admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:15.932649 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650006e2-a2cc-47d3-a7dc-ac6e97ccd64c admin admin] PATH_INFO: `/v3/users/77adb64c62704c428547534284019188` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:15.933829 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650006e2-a2cc-47d3-a7dc-ac6e97ccd64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=77adb64c62704c428547534284019188)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:15.935803 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650006e2-a2cc-47d3-a7dc-ac6e97ccd64c admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:15.979747 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-650006e2-a2cc-47d3-a7dc-ac6e97ccd64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77adb64c62704c428547534284019188'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:15.991255 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-650006e2-a2cc-47d3-a7dc-ac6e97ccd64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77adb64c62704c428547534284019188'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:15.991937 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-650006e2-a2cc-47d3-a7dc-ac6e97ccd64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77adb64c62704c428547534284019188'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:15.992630 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-650006e2-a2cc-47d3-a7dc-ac6e97ccd64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77adb64c62704c428547534284019188'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:16.000141 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-650006e2-a2cc-47d3-a7dc-ac6e97ccd64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77adb64c62704c428547534284019188'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:16.012240 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 628/1247] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 14 12:06:15 2022] DELETE /identity/v3/users/77adb64c62704c428547534284019188 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:06:16.184848 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:16.186362 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:16.199628 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9f35d-7bf4-4ace-87b9-2418d3b36877 admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:16.257160 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:16.258082 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:16.258363 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:16.258653 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b admin admin] PATH_INFO: `/v3/projects/15d5e29729564682ae4338be71d3c81f` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:16.260616 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d5e29729564682ae4338be71d3c81f)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:16.262598 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:16.284642 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:06:16.312763 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d5e29729564682ae4338be71d3c81f', 'request_id': 'req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:16.318997 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d5e29729564682ae4338be71d3c81f', 'request_id': 'req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:16.325199 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d5e29729564682ae4338be71d3c81f', 'request_id': 'req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:16.337512 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b admin admin] The token cache is being invalidate because project 15d5e29729564682ae4338be71d3c81f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:06:16.337801 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:16.338421 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:06:16.340010 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 620/1248] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 14 12:06:16 2022] DELETE /identity/v3/projects/15d5e29729564682ae4338be71d3c81f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:06:26.008696 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:06:26.334392 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:06:35.000845 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0336fd-5b42-4d56-9368-904c50e63c9b None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:35.001338 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0336fd-5b42-4d56-9368-904c50e63c9b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:35.001430 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0336fd-5b42-4d56-9368-904c50e63c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:35.019527 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0f0336fd-5b42-4d56-9368-904c50e63c9b None None] MFA Rules not processed for user `7fddb99331e44f22bb65fa2ca0d4850d`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:06:35.020713 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0f0336fd-5b42-4d56-9368-904c50e63c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:35.075155 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 629/1249] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 14 12:06:34 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:06:35.388327 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:35.389782 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:35.445293 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f573f-3b0e-4b2d-936b-a2e9e2f1a46b admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:35.448802 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ff5ca-766f-4da2-8417-9010455bed1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:35.449442 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff5ca-766f-4da2-8417-9010455bed1f service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:35.449725 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff5ca-766f-4da2-8417-9010455bed1f service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:35.450001 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff5ca-766f-4da2-8417-9010455bed1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:35.451738 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-742ff5ca-766f-4da2-8417-9010455bed1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:35.460648 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ff5ca-766f-4da2-8417-9010455bed1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:35.462061 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ff5ca-766f-4da2-8417-9010455bed1f service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:35.469745 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 621/1250] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:06:35 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:06:35.911604 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0336fd-5b42-4d56-9368-904c50e63c9b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:35.913049 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0f0336fd-5b42-4d56-9368-904c50e63c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:35.984817 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0336fd-5b42-4d56-9368-904c50e63c9b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:35.990001 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5879970-08ac-4b44-833b-17cedaa43291 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de477915cf5e41e8a65a57e8b546997f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:35.990657 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5879970-08ac-4b44-833b-17cedaa43291 service placement] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:35.990944 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5879970-08ac-4b44-833b-17cedaa43291 service placement] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:35.991223 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5879970-08ac-4b44-833b-17cedaa43291 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:35.993026 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c5879970-08ac-4b44-833b-17cedaa43291 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:36.004555 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5879970-08ac-4b44-833b-17cedaa43291 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:36.006143 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5879970-08ac-4b44-833b-17cedaa43291 service placement] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:36.016448 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 630/1251] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:06:35 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:06:44.901020 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ff5ca-766f-4da2-8417-9010455bed1f service neutron] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:44.902489 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-742ff5ca-766f-4da2-8417-9010455bed1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:44.973269 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ff5ca-766f-4da2-8417-9010455bed1f service neutron] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:44.979131 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09920c6c-fb28-486c-aa96-8cf6b92fb597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd8e197398e465aa3247d2ea89430d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:44.979781 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09920c6c-fb28-486c-aa96-8cf6b92fb597 service nova] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:44.980107 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09920c6c-fb28-486c-aa96-8cf6b92fb597 service nova] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:44.980391 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09920c6c-fb28-486c-aa96-8cf6b92fb597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:44.982180 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-09920c6c-fb28-486c-aa96-8cf6b92fb597 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:44.993296 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09920c6c-fb28-486c-aa96-8cf6b92fb597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:44.994948 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09920c6c-fb28-486c-aa96-8cf6b92fb597 service nova] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:45.004500 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 622/1252] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:06:44 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:06:46.012446 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=57 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:06:55.000603 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=58 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:03.905590 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5879970-08ac-4b44-833b-17cedaa43291 service placement] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:03.906995 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c5879970-08ac-4b44-833b-17cedaa43291 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:03.977359 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5879970-08ac-4b44-833b-17cedaa43291 service placement] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:03.982750 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b81d8-5435-41fa-a419-1bdf9803dc81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de477915cf5e41e8a65a57e8b546997f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:03.983401 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b81d8-5435-41fa-a419-1bdf9803dc81 service placement] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:03.983692 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b81d8-5435-41fa-a419-1bdf9803dc81 service placement] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:03.984011 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b81d8-5435-41fa-a419-1bdf9803dc81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:03.985800 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-873b81d8-5435-41fa-a419-1bdf9803dc81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:03.997524 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b81d8-5435-41fa-a419-1bdf9803dc81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:03.999116 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b81d8-5435-41fa-a419-1bdf9803dc81 service placement] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:04.009748 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 631/1253] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:03 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:14.005702 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=28 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:20.549402 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09920c6c-fb28-486c-aa96-8cf6b92fb597 service nova] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:20.571771 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09920c6c-fb28-486c-aa96-8cf6b92fb597 service nova] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:20.575362 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27b2c2-acc0-489d-a9b8-a4d30fd740ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '336c852c9dfb4c6a8ee62134c2ff32ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:20.576041 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27b2c2-acc0-489d-a9b8-a4d30fd740ae service neutron] REQUEST_METHOD: `GET` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:20.576333 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27b2c2-acc0-489d-a9b8-a4d30fd740ae service neutron] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:20.576613 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27b2c2-acc0-489d-a9b8-a4d30fd740ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:20.578387 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-9b27b2c2-acc0-489d-a9b8-a4d30fd740ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:20.662874 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27b2c2-acc0-489d-a9b8-a4d30fd740ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:20.664356 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27b2c2-acc0-489d-a9b8-a4d30fd740ae service neutron] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:20.673866 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 623/1254] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:23.857435 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5377db-d77b-4edb-9ab6-2b1ad7f0a981 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:23.857909 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5377db-d77b-4edb-9ab6-2b1ad7f0a981 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:23.858011 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5377db-d77b-4edb-9ab6-2b1ad7f0a981 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:23.859352 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 632/1255] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 14 12:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:09:23.869074 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5530f92-5ddd-4e6e-8c82-cb8f64eabfe6 None None] REQUEST_METHOD: `POST` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:23.869554 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5530f92-5ddd-4e6e-8c82-cb8f64eabfe6 None None] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:23.869946 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5530f92-5ddd-4e6e-8c82-cb8f64eabfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:23.904014 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.auth.core [None req-a5530f92-5ddd-4e6e-8c82-cb8f64eabfe6 None None] MFA Rules not processed for user `de477915cf5e41e8a65a57e8b546997f`. Rule list: `[]` (Enabled: `True`). {{(pid=87129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:23.905237 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-a5530f92-5ddd-4e6e-8c82-cb8f64eabfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:23.915523 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 624/1256] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 14 12:09:23 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:23.928179 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5377db-d77b-4edb-9ab6-2b1ad7f0a981 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:23.944498 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5377db-d77b-4edb-9ab6-2b1ad7f0a981 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:23.953411 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c5f9-1604-4627-8c5e-fec84bcd78f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de477915cf5e41e8a65a57e8b546997f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b711bbd57a5446a39ee7c2cf96356083', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:23.954061 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c5f9-1604-4627-8c5e-fec84bcd78f6 service placement] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:23.954348 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c5f9-1604-4627-8c5e-fec84bcd78f6 service placement] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:23.954626 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c5f9-1604-4627-8c5e-fec84bcd78f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:23.964660 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817c5f9-1604-4627-8c5e-fec84bcd78f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:23.966281 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817c5f9-1604-4627-8c5e-fec84bcd78f6 service placement] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:23.978218 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 633/1257] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:23 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:09:27.212893 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5530f92-5ddd-4e6e-8c82-cb8f64eabfe6 None None] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:27.214405 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-a5530f92-5ddd-4e6e-8c82-cb8f64eabfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:27.235499 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5530f92-5ddd-4e6e-8c82-cb8f64eabfe6 None None] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:27.240847 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae86398-1a10-43dd-85c2-9d10543ac3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:27.241932 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86398-1a10-43dd-85c2-9d10543ac3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:27.242212 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86398-1a10-43dd-85c2-9d10543ac3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:27.242486 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86398-1a10-43dd-85c2-9d10543ac3f3 admin admin] PATH_INFO: `/v3/users/7fddb99331e44f22bb65fa2ca0d4850d` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:27.243665 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae86398-1a10-43dd-85c2-9d10543ac3f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fddb99331e44f22bb65fa2ca0d4850d)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:27.245628 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae86398-1a10-43dd-85c2-9d10543ac3f3 admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:27.293406 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-cae86398-1a10-43dd-85c2-9d10543ac3f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fddb99331e44f22bb65fa2ca0d4850d'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:27.306870 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-cae86398-1a10-43dd-85c2-9d10543ac3f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fddb99331e44f22bb65fa2ca0d4850d'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:27.307698 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-cae86398-1a10-43dd-85c2-9d10543ac3f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fddb99331e44f22bb65fa2ca0d4850d'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:27.308344 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-cae86398-1a10-43dd-85c2-9d10543ac3f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fddb99331e44f22bb65fa2ca0d4850d'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:27.315492 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-cae86398-1a10-43dd-85c2-9d10543ac3f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fddb99331e44f22bb65fa2ca0d4850d'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:27.328172 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 625/1258] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:27 2022] DELETE /identity/v3/users/7fddb99331e44f22bb65fa2ca0d4850d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:27.504391 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c5f9-1604-4627-8c5e-fec84bcd78f6 service placement] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:27.523035 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c5f9-1604-4627-8c5e-fec84bcd78f6 service placement] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:27.583728 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae7093-0064-4189-8d4c-2e91ec51c3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:27.584534 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae7093-0064-4189-8d4c-2e91ec51c3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:27.584820 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae7093-0064-4189-8d4c-2e91ec51c3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:27.585098 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae7093-0064-4189-8d4c-2e91ec51c3a7 admin admin] PATH_INFO: `/v3/projects/bb1444554c6b4fc7a3b3b497be241120` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:27.586265 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae7093-0064-4189-8d4c-2e91ec51c3a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1444554c6b4fc7a3b3b497be241120)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:27.588192 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae7093-0064-4189-8d4c-2e91ec51c3a7 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:27.632320 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1dae7093-0064-4189-8d4c-2e91ec51c3a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1444554c6b4fc7a3b3b497be241120', 'request_id': 'req-1dae7093-0064-4189-8d4c-2e91ec51c3a7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:27.638129 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1dae7093-0064-4189-8d4c-2e91ec51c3a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1444554c6b4fc7a3b3b497be241120', 'request_id': 'req-1dae7093-0064-4189-8d4c-2e91ec51c3a7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:27.643465 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1dae7093-0064-4189-8d4c-2e91ec51c3a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1444554c6b4fc7a3b3b497be241120', 'request_id': 'req-1dae7093-0064-4189-8d4c-2e91ec51c3a7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:27.656124 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1dae7093-0064-4189-8d4c-2e91ec51c3a7 admin admin] The token cache is being invalidate because project bb1444554c6b4fc7a3b3b497be241120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:27.656415 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1dae7093-0064-4189-8d4c-2e91ec51c3a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:27.657033 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1dae7093-0064-4189-8d4c-2e91ec51c3a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:27.658568 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 634/1259] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:27 2022] DELETE /identity/v3/projects/bb1444554c6b4fc7a3b3b497be241120 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:27.663100 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae86398-1a10-43dd-85c2-9d10543ac3f3 admin admin] Authenticating user token {{(pid=87129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:27.664559 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.fernet_utils [None req-cae86398-1a10-43dd-85c2-9d10543ac3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:27.678605 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae86398-1a10-43dd-85c2-9d10543ac3f3 admin admin] Validating token access rules against request {{(pid=87129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:27.696528 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:27.741555 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153a66b-bf7b-4ee2-b294-f9c24531f204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:27.742593 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153a66b-bf7b-4ee2-b294-f9c24531f204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:27.742983 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153a66b-bf7b-4ee2-b294-f9c24531f204 admin admin] SCRIPT_NAME: `/identity` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:27.743483 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153a66b-bf7b-4ee2-b294-f9c24531f204 admin admin] PATH_INFO: `/v3/users/ddcc2df58ded481ba88d81b85a482331` {{(pid=87129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:27.745047 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153a66b-bf7b-4ee2-b294-f9c24531f204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddcc2df58ded481ba88d81b85a482331)` {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:27.747140 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153a66b-bf7b-4ee2-b294-f9c24531f204 admin admin] RBAC: Authorization granted {{(pid=87129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:27.798349 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-9153a66b-bf7b-4ee2-b294-f9c24531f204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddcc2df58ded481ba88d81b85a482331'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:27.811866 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-9153a66b-bf7b-4ee2-b294-f9c24531f204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddcc2df58ded481ba88d81b85a482331'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:27.812653 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-9153a66b-bf7b-4ee2-b294-f9c24531f204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddcc2df58ded481ba88d81b85a482331'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:27.813297 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-9153a66b-bf7b-4ee2-b294-f9c24531f204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddcc2df58ded481ba88d81b85a482331'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:27.820882 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG keystone.notifications [None req-9153a66b-bf7b-4ee2-b294-f9c24531f204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddcc2df58ded481ba88d81b85a482331'} {{(pid=87129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:27.834492 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: [pid: 87129|app: 0|req: 626/1260] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:27 2022] DELETE /identity/v3/users/ddcc2df58ded481ba88d81b85a482331 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:28.021857 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae7093-0064-4189-8d4c-2e91ec51c3a7 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:28.023407 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1dae7093-0064-4189-8d4c-2e91ec51c3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:28.036382 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae7093-0064-4189-8d4c-2e91ec51c3a7 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:28.093165 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d945bce-de83-4d42-8776-002374eca8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e96f467bcdaf40f288963da3024186a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98e8f9ea0c4446b68d2be9ca4901c939', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:28.093951 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d945bce-de83-4d42-8776-002374eca8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:28.094242 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d945bce-de83-4d42-8776-002374eca8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:28.094525 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d945bce-de83-4d42-8776-002374eca8c8 admin admin] PATH_INFO: `/v3/projects/9db9662307b14f589c43112c648f0a8c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:28.095687 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d945bce-de83-4d42-8776-002374eca8c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db9662307b14f589c43112c648f0a8c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:28.097635 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d945bce-de83-4d42-8776-002374eca8c8 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:28.118693 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:28.144404 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8d945bce-de83-4d42-8776-002374eca8c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db9662307b14f589c43112c648f0a8c', 'request_id': 'req-8d945bce-de83-4d42-8776-002374eca8c8'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:28.150331 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8d945bce-de83-4d42-8776-002374eca8c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db9662307b14f589c43112c648f0a8c', 'request_id': 'req-8d945bce-de83-4d42-8776-002374eca8c8'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:28.155649 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8d945bce-de83-4d42-8776-002374eca8c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db9662307b14f589c43112c648f0a8c', 'request_id': 'req-8d945bce-de83-4d42-8776-002374eca8c8'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:28.168618 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8d945bce-de83-4d42-8776-002374eca8c8 admin admin] The token cache is being invalidate because project 9db9662307b14f589c43112c648f0a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:28.168912 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8d945bce-de83-4d42-8776-002374eca8c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:28.169544 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8d945bce-de83-4d42-8776-002374eca8c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:28.171092 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 635/1261] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:28 2022] DELETE /identity/v3/projects/9db9662307b14f589c43112c648f0a8c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:37.829904 dv-osbrick-849324-4-ceph devstack@keystone.service[87129]: DEBUG dbcounter [-] [87129] Writing DB stats keystone:SELECT=44,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:38.165589 dv-osbrick-849324-4-ceph devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}